-- Logs begin at Mon 2022-02-28 17:57:46 UTC, end at Mon 2022-02-28 19:07:54 UTC. -- Feb 28 18:28:29.372125 dv-cinder-831188-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 28 18:28:29.379931 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 18:28:29 2022] *** Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: nodename: dv-cinder-831188-1-iscsi Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: machine: x86_64 Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: clock source: unix Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: pcre jit disabled Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: detected number of CPU cores: 4 Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: current working directory: / Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: detected binary path: /usr/bin/uwsgi-core Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: your processes number limit is 47680 Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: your memory page size is 4096 bytes Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: detected max file descriptor number: 2048 Feb 28 18:28:29.381965 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: lock engine: pthread robust mutexes Feb 28 18:28:29.382865 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: thunder lock: enabled Feb 28 18:28:29.382865 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 28 18:28:29.382865 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 18:28:29.423482 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: Python main interpreter initialized at 0x55c0d92489c0 Feb 28 18:28:29.423482 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: python threads support enabled Feb 28 18:28:29.423482 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: your server socket listen backlog is limited to 100 connections Feb 28 18:28:29.423482 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: your mercy for graceful operations on workers is 90 seconds Feb 28 18:28:29.423876 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 18:28:29.423939 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: *** Operational MODE: preforking *** Feb 28 18:28:29.424200 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: *** uWSGI is running in multiple interpreter mode *** Feb 28 18:28:29.424200 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: spawned uWSGI master process (pid: 66282) Feb 28 18:28:29.424415 dv-cinder-831188-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 28 18:28:29.425537 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: spawned uWSGI worker 1 (pid: 66296, cores: 1) Feb 28 18:28:29.425537 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: spawned uWSGI worker 2 (pid: 66297, cores: 1) Feb 28 18:28:29.425537 dv-cinder-831188-1-iscsi devstack@keystone.service[66282]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 18:28:32.204349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 18:28:32.204947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 18:28:32.205031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 18:28:32.205031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 18:28:32.205474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] command line args: [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 18:28:32.205474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 18:28:32.205580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] command line args: [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 18:28:32.205642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ================================================================================ {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 18:28:32.205705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 18:28:32.205770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] admin_token = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.205828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ================================================================================ {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 18:28:32.205897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] config_dir = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.205955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] admin_token = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] config_dir = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] config_source = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] debug = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] config_source = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.206850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] debug = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.208949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_config_append = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_config_append = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_dir = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_file = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_dir = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_file = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.209963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.210961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.211676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.211918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.212090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.212288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.212479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.212666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.212858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.213541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.213683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.213802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] publish_errors = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.213941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] publish_errors = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214573 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.214975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] standard_threads = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] standard_threads = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.215978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] use_journal = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] use_journal = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] use_json = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] use_json = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] use_stderr = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] use_stderr = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] use_syslog = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] use_syslog = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.216969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:28:32.217045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.217977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218184 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.218935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.219936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.220879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.221990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.222953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.223933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.224927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.225004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.225162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.225284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.225362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.225446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.225623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226611 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.226997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227451 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.227927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.228947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229920 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.229995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.230931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.231959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.232846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.external = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.233976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.external = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.234868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.password = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.password = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] auth.token = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] auth.token = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.235920 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.236930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.237903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.238906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.239960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.240966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.241933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.242925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.243924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.244890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.245863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.246852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.247889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.248997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.249895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.250919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.251978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.252942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.253018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.253170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.253254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.253407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.253651 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.253892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.254126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.254363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.254636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.254744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.254895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.255815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.256071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.256317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.256580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.256842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.257895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.258924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.259908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.260855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.261856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.262998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.263074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.263235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.263474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.263782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.264036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.264278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.264539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.264773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.265998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.266077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.266258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.266507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.266660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.266773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.266863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.267977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.268951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] role.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.269981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] role.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.270140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.270217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.270391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.270665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.270921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.271174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.271426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.271677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.271930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.272185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.272420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.272672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.272748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.272923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.273978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] role.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] role.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.274846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.275876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.276907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.277986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.278948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.279995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.280951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.281919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.282967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.connection = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.283949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.284910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.285856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.286839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.287005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.287095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.287242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.287320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.connection = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.287412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 18:28:32.287528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.287778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.288034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.288276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.288513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.288751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.288987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.289223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.289469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.289714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.289956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.290189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.290437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.290698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.290946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.291177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.291415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.291650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:28:32.291818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66297) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 18:28:32.313922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.314152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.314376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.315034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.315265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.315487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.323693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.324699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.352407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.352674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.353184 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.353417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.406895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.407404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.457873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.458033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.460383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.460628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.522767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.522930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.523952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.548682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.548960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.549985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.550059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.550275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.561360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.561609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.574932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66297) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.575907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66296) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 18:28:32.592422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.592609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:28:32.592974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.593097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.593166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:28:32.593226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:28:32.593422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.593548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.593660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.593752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 18:28:32.593941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.594074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.594159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.594239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.594465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.594745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.604764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.605038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.605294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.605417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.605571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.605697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.605880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.606156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.613766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.614164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.616894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.617172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.617314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.617422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.617512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.617731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.617861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.617979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.618855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.619833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.645219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.645443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.646772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.647018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.647147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.647301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.652069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.652303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.652429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.652706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.652829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.652981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.659709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.659987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.660110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.660257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.664249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.664502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.664629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.664778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.664904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.665925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.666102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.666228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.666374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.684279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.684424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.684498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.684669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.689046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.689174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.692614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.692742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.692897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.693024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.697790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.697918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.701308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.701436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.704803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.704930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705780 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.705991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.706202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.706329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.724705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.724841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.724914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.725117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.725244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.725357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.725463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.725655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.733343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.733700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.735116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.735386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.735533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.735734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.738267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.738540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.738696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.738819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.738912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.739126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.739255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.739405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.739545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.739703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.753635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.753766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.753880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.754933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.755058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.755177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.755271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.755473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.772499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.773104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.847583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.847801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.851086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.851244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.852603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.852729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.854147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.854275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.854429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.854678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.854766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.854832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.861885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.862013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.863426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.863551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.866507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.866660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.866821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.866966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.867072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.867163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.867377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.867502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.876280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.876577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.876701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.876854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.876980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.877144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.884502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66297) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.884678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66296) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 18:28:32.884775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.884948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.885919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.886886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.887910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.888050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66297) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.888259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66296) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 18:28:32.924636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55c0d92489c0 pid: 66296 (default app) Feb 28 18:28:32.924765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55c0d92489c0 pid: 66297 (default app) Feb 28 18:28:32.928019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde95d-b8f4-44ae-9068-590cf94bc2ad None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:32.928323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde95d-b8f4-44ae-9068-590cf94bc2ad None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:32.928608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde95d-b8f4-44ae-9068-590cf94bc2ad None None] PATH_INFO: `/v3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:32.932771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Feb 28 18:28:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:38.443262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09735bc-4f0d-4bd2-bdff-7dabb682b49e None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:38.444090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09735bc-4f0d-4bd2-bdff-7dabb682b49e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:38.444232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09735bc-4f0d-4bd2-bdff-7dabb682b49e None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:38.452681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:38.459396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:38.459798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:38.459903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:38.506544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG oslo_db.sqlalchemy.engines [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66297) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:28:38.659098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG passlib.handlers.bcrypt [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66297) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Feb 28 18:28:38.659522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG passlib.handlers.bcrypt [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66297) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Feb 28 18:28:38.721264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:38.722825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:38.828503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:38 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:39.017951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09735bc-4f0d-4bd2-bdff-7dabb682b49e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:39.069953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG oslo_db.sqlalchemy.engines [None req-f09735bc-4f0d-4bd2-bdff-7dabb682b49e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:28:39.164349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09735bc-4f0d-4bd2-bdff-7dabb682b49e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:39.169689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:39.170286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:39.170590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:39.170899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:39.179958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:39.211629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 18:28:39.211977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd14de0-3639-4968-a9f0-ff6e252d1818 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:39.221897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:28:39 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:28:39.231320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:39.243555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd6c9c-4ee5-47ad-a5cd-6d5d8ae4cd99 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:39.250589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:39.251918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:39.252402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:39.252870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] PATH_INFO: `/v3/projects/59acec3e713d40f0a23abdd9569d7387` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:39.255176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=59acec3e713d40f0a23abdd9569d7387)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:39.289950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.common.rbac_enforcer.enforcer [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 18:28:39.290224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6f16c-f3c1-41d3-a696-4d9bab67c3a2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:39.294839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:28:39 2022] GET /identity/v3/projects/59acec3e713d40f0a23abdd9569d7387 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:28:41.253575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312fb5-f030-490d-88ac-deed744aedd1 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:41.254397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312fb5-f030-490d-88ac-deed744aedd1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:41.254588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312fb5-f030-490d-88ac-deed744aedd1 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:41.261926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:41.268617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:41.269379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:41.269531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:41.298233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:41.299763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:41.308436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:41.331480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312fb5-f030-490d-88ac-deed744aedd1 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:41.349655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312fb5-f030-490d-88ac-deed744aedd1 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:41.355620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b699eda-d348-41a4-9ef6-0a648d84c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:41.356470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699eda-d348-41a4-9ef6-0a648d84c260 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:41.356771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699eda-d348-41a4-9ef6-0a648d84c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:41.357056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b699eda-d348-41a4-9ef6-0a648d84c260 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:41.365803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b699eda-d348-41a4-9ef6-0a648d84c260 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:41.392879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b699eda-d348-41a4-9ef6-0a648d84c260 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:41.401382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:28:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:28:41.410305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:41.426717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12d71-fe98-4a68-8f1b-5cb3f25c1bf3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:41.435581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc03a4-8185-459f-970d-141db286fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:41.436480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc03a4-8185-459f-970d-141db286fb89 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:41.436772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc03a4-8185-459f-970d-141db286fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:41.437051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc03a4-8185-459f-970d-141db286fb89 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:41.438543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc03a4-8185-459f-970d-141db286fb89 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:41.465558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc03a4-8185-459f-970d-141db286fb89 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:41.467068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:28:41 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:43.453857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0b69-07eb-4050-b475-00309b0c138b None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.454771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0b69-07eb-4050-b475-00309b0c138b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.454771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0b69-07eb-4050-b475-00309b0c138b None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.457487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:43.463713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.464149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.464345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.488252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:43.489341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:43.496532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:43.519774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba0b69-07eb-4050-b475-00309b0c138b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:43.537290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba0b69-07eb-4050-b475-00309b0c138b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:43.543078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:43.543801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.544087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.544344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.558662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:28:43.565520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:28:43.566651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 6/12] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:28:43.575369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:43.589158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e7b0d-3eae-4a6d-89f4-00d8cca04752 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:43.596034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:43.596635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.596920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.597210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.597931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:28:43.598232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:43.623580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:43.623580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:28:43.623580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:28:43.624545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:43.636784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 7/13] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:43.645611 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:43.659721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37598ae-be42-44b4-b3b8-10e72bd4fca9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:43.664960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:43.665737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.666018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.666293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.667973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:43.693396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:43.694849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:28:43 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:43.702286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:43.712813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc721c3-9dcd-414a-865f-d569809d47ae admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:43.718457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ab860-7958-4972-a5cd-bd197ff94fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:43.719203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ab860-7958-4972-a5cd-bd197ff94fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.719487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ab860-7958-4972-a5cd-bd197ff94fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.719770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ab860-7958-4972-a5cd-bd197ff94fe6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.720885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ab860-7958-4972-a5cd-bd197ff94fe6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:43.747258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ab860-7958-4972-a5cd-bd197ff94fe6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:43.748666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:43.754545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:43.764715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53b58-4f02-4ae8-8c0d-c82e16ea34e9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:43.769936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:43.770501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:43.770821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:43.771092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:43.771870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.domain.id=default, user.id=3e8eb57551f64caeac7429bc645c3ee4) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:28:43.772165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:43.796916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:43.796916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:28:43.796916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:28:43.798080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef730a-b66c-4458-aead-2f6a9c2d5700 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:43.805357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 8/16] 10.222.0.18 () {56 vars in 1343 bytes} [Mon Feb 28 18:28:43 2022] GET /identity/v3/role_assignments?user.id=3e8eb57551f64caeac7429bc645c3ee4&scope.domain.id=default&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 233 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:45.768527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeae5c-3fdf-4d4d-a7b0-ca964cd969db None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:45.769421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeae5c-3fdf-4d4d-a7b0-ca964cd969db None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:45.769421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeae5c-3fdf-4d4d-a7b0-ca964cd969db None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:45.772631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 9/17] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:45.778214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:45.778681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:45.778767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:45.813216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG passlib.handlers.bcrypt [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66296) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Feb 28 18:28:45.813631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG passlib.handlers.bcrypt [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66296) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Feb 28 18:28:45.860096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:45.861614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:45.869943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 9/18] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:45.893029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeae5c-3fdf-4d4d-a7b0-ca964cd969db None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:45.912021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeae5c-3fdf-4d4d-a7b0-ca964cd969db None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:45.917255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:45.917977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:45.918268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:45.918572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:45.932361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:28:45.939014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:28:45.940151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:28:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:28:45.948978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:45.962518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702c7f9-ed1f-4b32-a2ec-ba5da1d32ad5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:45.969762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:45.970786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:45.971309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:45.971827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:45.973058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:28:45.973549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:46.002309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:46.002309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:28:46.002309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:28:46.003774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:46.015812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:46.022538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:46.040225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b574a8-6a1f-4138-b81b-e52e9e6376a6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:46.048029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:46.048831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:46.049120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:46.049399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:46.050601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:46.075598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:46.077037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:28:46 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:46.085608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:46.102130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e83c2-dbff-4f4b-8433-70d740eced66 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:46.110354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b64a-d60b-4738-a9a1-0c07039035f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:46.111105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b64a-d60b-4738-a9a1-0c07039035f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:46.111390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b64a-d60b-4738-a9a1-0c07039035f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:46.111670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b64a-d60b-4738-a9a1-0c07039035f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:46.112908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b64a-d60b-4738-a9a1-0c07039035f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:46.137699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b64a-d60b-4738-a9a1-0c07039035f8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:46.139156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 11/22] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:28:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:46.145460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:46.161383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151089b-f860-4dff-a33b-93a217a5c996 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:46.168360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:46.169158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:46.169441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:46.169704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] PATH_INFO: `/v3/domains/default/users/3e8eb57551f64caeac7429bc645c3ee4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:46.171856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e8eb57551f64caeac7429bc645c3ee4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:46.196006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:46.196006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:28:46.196006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:28:46.197969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519af604-1ac1-4d38-9438-5b2a2eb72f12 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:46.401300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1382 bytes} [Mon Feb 28 18:28:46 2022] PUT /identity/v3/domains/default/users/3e8eb57551f64caeac7429bc645c3ee4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:28:48.351311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71419-e0a1-4acc-9eec-6af08fcc5cd8 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.351846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71419-e0a1-4acc-9eec-6af08fcc5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.351846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71419-e0a1-4acc-9eec-6af08fcc5cd8 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.353559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:48.361377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.362098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.362317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.397833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:48.399360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:48.466388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:48.495924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c71419-e0a1-4acc-9eec-6af08fcc5cd8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:48.508583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c71419-e0a1-4acc-9eec-6af08fcc5cd8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:48.512909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:48.513621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.513905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.514190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.526514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:28:48.532735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:28:48.533830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 13/26] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:28:48.539685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:48.549309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216dd3f-9378-4bfc-a49c-510aa7555343 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:48.555693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:48.556695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.557177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.557600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.558765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:28:48.559256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:48.592344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:48.605573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 14/27] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:48.612112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:48.626761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a38d64-f9fe-4c2c-8dbe-2426cefca24e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:48.632815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:48.633598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.633887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.634164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.635533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:48.660606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:48.662046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:28:48 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:48.670350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:48.686016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eda18-cc3e-49b9-ab2b-a8bc5fa33f64 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:48.692434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387386-2d45-477b-8130-521679a4f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:48.693152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387386-2d45-477b-8130-521679a4f07f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.693527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387386-2d45-477b-8130-521679a4f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.693814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387386-2d45-477b-8130-521679a4f07f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.695322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab387386-2d45-477b-8130-521679a4f07f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:48.720740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab387386-2d45-477b-8130-521679a4f07f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:48.722121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 15/29] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:48.728633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:48.744680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe29e97-4ea4-444c-9c80-87083da9c6c0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:48.751969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:48.752535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:48.752828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:48.753106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:48.753879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.domain.id=default, user.id=3e8eb57551f64caeac7429bc645c3ee4) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:28:48.754183 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:48.779001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bf044-f161-449d-a969-4d4fbb8bc9cb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:48.785404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 15/30] 10.222.0.18 () {56 vars in 1343 bytes} [Mon Feb 28 18:28:48 2022] GET /identity/v3/role_assignments?user.id=3e8eb57551f64caeac7429bc645c3ee4&scope.domain.id=default&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 530 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:50.762003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910361d-70bc-4d15-a9b5-7147e4dc4d6c None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:50.762611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910361d-70bc-4d15-a9b5-7147e4dc4d6c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:50.762611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910361d-70bc-4d15-a9b5-7147e4dc4d6c None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:50.764307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 16/31] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:50.770845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:50.771568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:50.771708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:50.804402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:50.805557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:50.813905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 16/32] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:50.835647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910361d-70bc-4d15-a9b5-7147e4dc4d6c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:50.853116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910361d-70bc-4d15-a9b5-7147e4dc4d6c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:50.858966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3731-8161-41d0-bca4-7571e8d06da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:50.859546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3731-8161-41d0-bca4-7571e8d06da7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:50.859840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3731-8161-41d0-bca4-7571e8d06da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:50.860121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3731-8161-41d0-bca4-7571e8d06da7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:50.868637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3731-8161-41d0-bca4-7571e8d06da7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:50.894025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3731-8161-41d0-bca4-7571e8d06da7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:50.902477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:28:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:28:50.909131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:50.923782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61c148-1df6-45f6-ab92-9c8f882c3731 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:50.932504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41eccf-4db1-475e-8bbe-97ac72e4046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:50.933658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41eccf-4db1-475e-8bbe-97ac72e4046a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:50.934137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41eccf-4db1-475e-8bbe-97ac72e4046a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:50.934620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41eccf-4db1-475e-8bbe-97ac72e4046a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:50.936644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41eccf-4db1-475e-8bbe-97ac72e4046a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:50.962150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41eccf-4db1-475e-8bbe-97ac72e4046a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:50.963628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:28:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:52.920078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f58fa7-bd0d-428a-93b4-52d083f9f187 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:52.920626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f58fa7-bd0d-428a-93b4-52d083f9f187 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:52.920626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f58fa7-bd0d-428a-93b4-52d083f9f187 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:52.922417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 18/35] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:52.928699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:52.929391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:52.929578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:52.962303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:52.963471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:52.970694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 18/36] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:52.993190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f58fa7-bd0d-428a-93b4-52d083f9f187 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:53.008197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f58fa7-bd0d-428a-93b4-52d083f9f187 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:53.013877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:53.014589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:53.014990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:53.015365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:53.027601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:53.052732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:53.070461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:28:53.071563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 19/37] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:28:53.078052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:53.092641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027449d-050b-45eb-8c73-b9067b601396 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:53.098972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:53.099564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:53.099852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:53.100131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:53.101165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:28:53.101466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:53.125906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:53.125906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:28:53.125906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:28:53.126820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5aee9a-9168-4ce3-81c6-1fe562365b20 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:53.145227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 19/38] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:28:53.154015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:53.164989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd0ee8-e11b-4bb1-a255-79db8e17cf7a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:53.170443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:53.170993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:53.171314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:53.171598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:53.172331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:53.196761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:53.196761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:28:53.196761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:28:53.197960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f4006-8411-448f-868a-93beb05d3f2c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:53.231791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:28:53 2022] POST /identity/v3/projects => generated 301 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:28:55.228698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de021683-d61e-403e-91ff-152f86405d51 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:55.229171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de021683-d61e-403e-91ff-152f86405d51 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:55.229248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de021683-d61e-403e-91ff-152f86405d51 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:55.231040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 20/40] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:55.236976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce6962-d099-42fd-8a00-39df144dc088 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:55.237397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce6962-d099-42fd-8a00-39df144dc088 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:55.237551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce6962-d099-42fd-8a00-39df144dc088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:55.261107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b8ce6962-d099-42fd-8a00-39df144dc088 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:55.262237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b8ce6962-d099-42fd-8a00-39df144dc088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:55.327940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 21/41] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:55.351408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de021683-d61e-403e-91ff-152f86405d51 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:55.372073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de021683-d61e-403e-91ff-152f86405d51 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:55.378384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:55.379004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:55.379267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:55.379566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:55.380264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:55.404743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:55.404743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:28:55.404743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:28:55.405733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade10e09-b4fe-4e1c-98da-544a0c931927 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:55.613782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:28:55 2022] POST /identity/v3/roles => generated 219 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:28:57.583166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d056b-36ea-4bbd-8ebe-bb4346013eb2 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:57.583704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d056b-36ea-4bbd-8ebe-bb4346013eb2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:57.583704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d056b-36ea-4bbd-8ebe-bb4346013eb2 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:57.585427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 22/43] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:57.592699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259a27b-71d0-42ee-a45d-95ebce7e8765 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:57.593482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259a27b-71d0-42ee-a45d-95ebce7e8765 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:57.594130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259a27b-71d0-42ee-a45d-95ebce7e8765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:57.620551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1259a27b-71d0-42ee-a45d-95ebce7e8765 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:57.622014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1259a27b-71d0-42ee-a45d-95ebce7e8765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:57.631058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 22/44] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:57.652968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d056b-36ea-4bbd-8ebe-bb4346013eb2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:57.667190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d056b-36ea-4bbd-8ebe-bb4346013eb2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:57.672595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:57.673180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:57.673464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:57.673749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:57.674448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:57.699121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:28:57.699121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:28:57.699121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:28:57.700024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbae03-9c25-43f1-b983-9e0cf82192df admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:57.719226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:28:57 2022] POST /identity/v3/roles => generated 225 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:28:59.741092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fede46-f04c-46c4-9864-a7261e4faf3a None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:59.741825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fede46-f04c-46c4-9864-a7261e4faf3a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:59.741825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fede46-f04c-46c4-9864-a7261e4faf3a None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:59.744555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 23/46] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:28:59.752994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4ed86-f04a-46c1-91ae-dd92bc85b1e8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:59.753429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4ed86-f04a-46c1-91ae-dd92bc85b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:59.753531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4ed86-f04a-46c1-91ae-dd92bc85b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:59.776917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f8b4ed86-f04a-46c1-91ae-dd92bc85b1e8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:28:59.778036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f8b4ed86-f04a-46c1-91ae-dd92bc85b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:28:59.786106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 24/47] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:28:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:28:59.808630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fede46-f04c-46c4-9864-a7261e4faf3a None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:28:59.829694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fede46-f04c-46c4-9864-a7261e4faf3a None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:28:59.835171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52efeb-22a4-4d77-8519-7f77acab236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:28:59.835762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52efeb-22a4-4d77-8519-7f77acab236b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:28:59.836043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52efeb-22a4-4d77-8519-7f77acab236b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:28:59.836321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52efeb-22a4-4d77-8519-7f77acab236b admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:28:59.837018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52efeb-22a4-4d77-8519-7f77acab236b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:28:59.862944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52efeb-22a4-4d77-8519-7f77acab236b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:28:59.879030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 24/48] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:28:59 2022] POST /identity/v3/roles => generated 223 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:29:01.865767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19657a1d-b76b-4b61-b492-cf070ffe44d7 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:01.866374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19657a1d-b76b-4b61-b492-cf070ffe44d7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:01.866374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19657a1d-b76b-4b61-b492-cf070ffe44d7 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:01.868084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 25/49] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:01.874330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:01.875053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:01.875311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:01.904668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:01.905961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:01.913827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 25/50] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:01.936912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19657a1d-b76b-4b61-b492-cf070ffe44d7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:01.955409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19657a1d-b76b-4b61-b492-cf070ffe44d7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:01.960677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042cdcb-00c1-44d1-b55b-0fc71fc570fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:01.961398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042cdcb-00c1-44d1-b55b-0fc71fc570fd admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:01.961684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042cdcb-00c1-44d1-b55b-0fc71fc570fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:01.961963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042cdcb-00c1-44d1-b55b-0fc71fc570fd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:01.963289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042cdcb-00c1-44d1-b55b-0fc71fc570fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:01.989056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042cdcb-00c1-44d1-b55b-0fc71fc570fd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:01.990505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:29:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:01.999433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:02.013574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2563a6-9112-41c8-ba16-47ea8e22ff62 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:02.020307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:02.020908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:02.021202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:02.021485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:02.022329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:02.046703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:29:02.046703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:29:02.046703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:29:02.047915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9254-5b34-47d2-9470-e2d548bd6e00 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:02.088546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 26/52] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:29:01 2022] POST /identity/v3/projects => generated 312 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:29:04.048293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd88d-7052-4ce6-a0fe-05818b83aef2 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:04.049196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd88d-7052-4ce6-a0fe-05818b83aef2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:04.049339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd88d-7052-4ce6-a0fe-05818b83aef2 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:04.052162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 27/53] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:04.061008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:04.061691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:04.061935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:04.094274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:04.095459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:04.166244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 27/54] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:04.191370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dd88d-7052-4ce6-a0fe-05818b83aef2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:04.204805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dd88d-7052-4ce6-a0fe-05818b83aef2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:04.209093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff5bf-92b1-4b67-b7ca-80b39305de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:04.209847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff5bf-92b1-4b67-b7ca-80b39305de27 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:04.210133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff5bf-92b1-4b67-b7ca-80b39305de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:04.210414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff5bf-92b1-4b67-b7ca-80b39305de27 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:04.212046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ff5bf-92b1-4b67-b7ca-80b39305de27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:04.238332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ff5bf-92b1-4b67-b7ca-80b39305de27 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:04.239833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:29:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:04.245856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:04.259792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00124551-a288-4907-8974-d54b8fbb3c43 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:04.266776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b92d6-c19c-4f51-bd35-c889fc485c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:04.267378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b92d6-c19c-4f51-bd35-c889fc485c5b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:04.267671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b92d6-c19c-4f51-bd35-c889fc485c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:04.267954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b92d6-c19c-4f51-bd35-c889fc485c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:04.268623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b92d6-c19c-4f51-bd35-c889fc485c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:04.293900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b92d6-c19c-4f51-bd35-c889fc485c5b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:04.326134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 28/56] 10.222.0.18 () {60 vars in 1161 bytes} [Mon Feb 28 18:29:04 2022] POST /identity/v3/projects => generated 298 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:29:06.301239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15937d-5024-4394-94c4-4b418ed1cd54 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:06.302087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15937d-5024-4394-94c4-4b418ed1cd54 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:06.302087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15937d-5024-4394-94c4-4b418ed1cd54 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:06.305322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 29/57] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:06.313142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:06.313569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:06.313674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:06.337499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:06.338678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:06.407619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 29/58] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:06.431309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15937d-5024-4394-94c4-4b418ed1cd54 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:06.444258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15937d-5024-4394-94c4-4b418ed1cd54 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:06.448132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1293ade-ef1c-4b47-a16a-6183fe70bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:06.448846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293ade-ef1c-4b47-a16a-6183fe70bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:06.449135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293ade-ef1c-4b47-a16a-6183fe70bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:06.449414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1293ade-ef1c-4b47-a16a-6183fe70bdbf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:06.450471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293ade-ef1c-4b47-a16a-6183fe70bdbf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:06.477029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1293ade-ef1c-4b47-a16a-6183fe70bdbf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:06.478398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 30/59] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:06.484536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:06.498882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810a63-ceb7-446a-99a9-853c842fd61f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:06.506329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:06.507358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:06.507843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:06.508337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:06.509440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:06.535991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:29:06.535991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:29:06.535991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:29:06.537204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643b3fb-0a22-4ff1-bfe7-680151bcf851 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:06.571056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 30/60] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:29:06 2022] POST /identity/v3/users => generated 275 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:29:08.572908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0be252-2eb9-4376-8af9-721380d85262 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.573449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0be252-2eb9-4376-8af9-721380d85262 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.573449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0be252-2eb9-4376-8af9-721380d85262 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.575208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 31/61] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:08.581631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.582336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.582600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.616182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:08.617335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:08.625228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 31/62] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:08.648209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0be252-2eb9-4376-8af9-721380d85262 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:08.667683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0be252-2eb9-4376-8af9-721380d85262 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:08.673495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:08.674217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.674477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.674824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.686649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:08.692957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:08.694049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 32/63] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:08.699558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:08.708994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f472508-aa95-4ea8-9814-05e003fa19d9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:08.715029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:08.715624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.715910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.716196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.716923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:08.717223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:08.742719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:08.752494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 32/64] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:08.758472 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:08.771490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818cdcf-d5df-44de-917a-0199a83acfdc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:08.776868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:08.777659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.777949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.778232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.799440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:08.824951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:08.826383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 33/65] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:08 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:08.832732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:08.846967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8ab27-384b-4556-bf87-20cf2d063fed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:08.852559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:08.853133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.853423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.853703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.862580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:08.892702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:08.901998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:08.908395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:08.923828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1baf4c-9c3d-4bd3-9ea1-1da4c9a18d48 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:08.932455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9c38-48bb-4cbe-9b20-5e498ecb47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:08.933660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9c38-48bb-4cbe-9b20-5e498ecb47fc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.934086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9c38-48bb-4cbe-9b20-5e498ecb47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.934502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9c38-48bb-4cbe-9b20-5e498ecb47fc admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.936525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9c38-48bb-4cbe-9b20-5e498ecb47fc admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:08.962277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9c38-48bb-4cbe-9b20-5e498ecb47fc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:08.963823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 34/67] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:08 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:08.969676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:08.978914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e9b80-8fe2-40b1-851e-8064a3a0c0ec admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:08.984955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:08.985534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:08.985822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:08.986103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:08.986900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] RBAC: Adding query filter params (role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6, user.id=66682466934f4f93b7c7be98ff60c7c0) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:08.987207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:09.012890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f927-29f2-46bc-bdd5-0be3f5e94653 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:09.018938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 34/68] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:08 2022] GET /identity/v3/role_assignments?user.id=66682466934f4f93b7c7be98ff60c7c0&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:29:10.950177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aef8a-65ea-4ee5-929c-5654bbde4ebb None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:10.950846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aef8a-65ea-4ee5-929c-5654bbde4ebb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:10.950846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391aef8a-65ea-4ee5-929c-5654bbde4ebb None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:10.953138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 35/69] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:10.958588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:10.959016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:10.959191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:10.988508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:10.989665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:10.997765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:11.019948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aef8a-65ea-4ee5-929c-5654bbde4ebb None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:11.032939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391aef8a-65ea-4ee5-929c-5654bbde4ebb None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:11.037462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:11.038179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:11.038474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:11.038777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:11.051418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:11.057689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:11.058798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:11.065021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:11.078942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715717-088b-4576-8afe-e51e1f8e5ab8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:11.084859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:11.085463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:11.085755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:11.086037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:11.086792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:11.087095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:11.112636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:11.122315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:11.131258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:11.148791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909e403-3004-4c7b-8783-28979b136e15 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:11.159068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:11.159866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:11.160158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:11.160439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:11.161695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:11.187210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:11.188704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:11 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:11.194612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:11.204762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea389-e29b-4e0a-9592-80d9a0bcf8df admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:11.209629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45e04c-a423-4eb1-b18a-91b6c11d7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:11.210697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45e04c-a423-4eb1-b18a-91b6c11d7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:11.211124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45e04c-a423-4eb1-b18a-91b6c11d7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:11.211557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45e04c-a423-4eb1-b18a-91b6c11d7bc1 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:11.213436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45e04c-a423-4eb1-b18a-91b6c11d7bc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:11.248485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45e04c-a423-4eb1-b18a-91b6c11d7bc1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:11.250238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:11 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:11.258360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:11.274104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031a0ba-4058-431f-be83-73d74a740935 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:11.281438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca11b1-7218-4f54-a8a5-332b5579b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:11.282264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca11b1-7218-4f54-a8a5-332b5579b4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:11.282584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca11b1-7218-4f54-a8a5-332b5579b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:11.282881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca11b1-7218-4f54-a8a5-332b5579b4f7 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/users/66682466934f4f93b7c7be98ff60c7c0/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:11.284960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca11b1-7218-4f54-a8a5-332b5579b4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3c0e728d554f76a7ce01429aa5c2d6, user_id=66682466934f4f93b7c7be98ff60c7c0, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:11.310846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca11b1-7218-4f54-a8a5-332b5579b4f7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:11.327866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:11 2022] PUT /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/users/66682466934f4f93b7c7be98ff60c7c0/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:29:13.405255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78955dc-edae-4225-839d-20aa94d83df3 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.406124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78955dc-edae-4225-839d-20aa94d83df3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.406703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78955dc-edae-4225-839d-20aa94d83df3 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.409373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 38/76] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:13.416939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.417404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.417501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.441502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:13.442665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:13.520136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 39/77] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:29:13.542396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78955dc-edae-4225-839d-20aa94d83df3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:13.554859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78955dc-edae-4225-839d-20aa94d83df3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:13.559158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:13.559874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.560163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.560445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.574381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:13.580728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:13.581819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:13.587971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:13.599524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a4e8e-3eae-40ff-9872-962a28443961 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:13.605484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:13.606082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.606377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.606713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.607420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:13.607723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:13.633308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:13.643585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:13.652839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:13.663942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075ec9b-3017-4213-adc2-672945ba4a02 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:13.669742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:13.670892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.671324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.671604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.673440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:13.699405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:13.700874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:13 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:13.709195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:13.725678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383b39b-df73-4bec-b972-8a8508d2afd2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:13.733762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:13.734846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.735136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.735418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.743467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:13.769625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:13.778689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 41/81] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:13 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:13.787426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:13.800949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02875-e419-4469-9e9b-43876ae3e0b4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:13.806575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b487-c267-4629-83ca-4dbf50b2b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:13.807363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b487-c267-4629-83ca-4dbf50b2b842 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.807654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b487-c267-4629-83ca-4dbf50b2b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.807931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b487-c267-4629-83ca-4dbf50b2b842 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.809223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b487-c267-4629-83ca-4dbf50b2b842 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:13.834583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b487-c267-4629-83ca-4dbf50b2b842 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:13.836091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:13 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:13.842394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:13.857624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dfc41-eb36-444f-b6bf-ef72e898a6d1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:13.864367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:13.864935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:13.865221 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:13.865498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:13.866276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] RBAC: Adding query filter params (role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6, user.id=66682466934f4f93b7c7be98ff60c7c0) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:13.866598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:13.891386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:29:13.891386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:29:13.891386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:29:13.892521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e1fd-f853-46a2-818d-f7e0a4b9025f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:13.899210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:13 2022] GET /identity/v3/role_assignments?user.id=66682466934f4f93b7c7be98ff60c7c0&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:15.919697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c31e-7449-4224-aab3-dcf3a66e4525 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:15.920278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c31e-7449-4224-aab3-dcf3a66e4525 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:15.920278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c31e-7449-4224-aab3-dcf3a66e4525 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:15.922000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 42/84] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:15.928390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:15.929131 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:15.929268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:15.957040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:15.958188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:15.966827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 43/85] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:15.995859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c31e-7449-4224-aab3-dcf3a66e4525 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:16.009586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c31e-7449-4224-aab3-dcf3a66e4525 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:16.014433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:16.015180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:16.015677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:16.016007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:16.028559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:16.035087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:29:16.036166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 43/86] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:29:16.042431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:16.053788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444466e-6e5c-435b-b0fa-8d7ab556871b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:16.059101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:16.059702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:16.059995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:16.060282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:16.061007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:16.061309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:16.086825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:16.095898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 44/87] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:16.104514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:16.116672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a9719-f69b-4102-8460-3b964677d7bc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:16.122050 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:16.122864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:16.123150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:16.123426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:16.124682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:16.153516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:16.155081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:16 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:16.161581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:16.173274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7217a-211d-4dce-b23b-1e097b9d1cae admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:16.178029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:16.178645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:16.178942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:16.179227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:16.187300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:16.212715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:16.223015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 45/89] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:16 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:16.229939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:16.242464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62bb8-4bd4-4c8e-9584-9d6d9db86ee2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:16.247002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb83cd-9d32-4b27-bdc7-1b2e1a5fe9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:16.247811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb83cd-9d32-4b27-bdc7-1b2e1a5fe9fa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:16.248095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb83cd-9d32-4b27-bdc7-1b2e1a5fe9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:16.248380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb83cd-9d32-4b27-bdc7-1b2e1a5fe9fa admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:16.249569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb83cd-9d32-4b27-bdc7-1b2e1a5fe9fa admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:16.275256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb83cd-9d32-4b27-bdc7-1b2e1a5fe9fa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:16.276771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 45/90] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:16 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:16.283732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:16.297954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce9f8c-1ca3-490c-96f3-ec189ff9cb37 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:16.303338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:16.303923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:16.304214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:16.304495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:16.305285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6, user.id=3e8eb57551f64caeac7429bc645c3ee4) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:16.305593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:16.331300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cf702-6e92-4218-84f8-ae947f4ee0b6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:16.336714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:16 2022] GET /identity/v3/role_assignments?user.id=3e8eb57551f64caeac7429bc645c3ee4&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:18.287869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5b02-cb1e-48ed-a92a-68cc07d75f94 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.288419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5b02-cb1e-48ed-a92a-68cc07d75f94 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.288419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5b02-cb1e-48ed-a92a-68cc07d75f94 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.290133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 46/92] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:18.296498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.297512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.297667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.333313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:18.334454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:18.341608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 47/93] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:18.370753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5b02-cb1e-48ed-a92a-68cc07d75f94 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:18.383846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5b02-cb1e-48ed-a92a-68cc07d75f94 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:18.387971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:18.388697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.388997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.389287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.401709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:18.408259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:29:18.409358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:18.415677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:18.427246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2360-7bd5-4a62-86b2-0fe09ab7f9ab None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:18.433056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:18.433652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.433939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.434218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.434954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:18.435255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:18.460457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:18.469646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:18.478382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:18.491056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848f96-c073-486a-9592-a72af15710c9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:18.495522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:18.496310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.496598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.496882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.498002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:18.523079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:18.524543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:18 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:18.530331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:18.546017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bc74-1aa7-4604-8bf2-8baaa0722f09 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:18.552162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a4a68-c222-46b3-8865-00895713f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:18.552947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4a68-c222-46b3-8865-00895713f32c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.553231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4a68-c222-46b3-8865-00895713f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.553510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4a68-c222-46b3-8865-00895713f32c admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.554780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a4a68-c222-46b3-8865-00895713f32c admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:18.580727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a4a68-c222-46b3-8865-00895713f32c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:18.582240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:18 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:18.587724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:18.597688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd949641-bc6d-420d-a49d-82a0d4275687 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:18.603110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:18.603903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:18.604184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:18.604466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/users/3e8eb57551f64caeac7429bc645c3ee4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:18.606590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3c0e728d554f76a7ce01429aa5c2d6, user_id=3e8eb57551f64caeac7429bc645c3ee4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:18.631256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:29:18.631256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:29:18.631256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:29:18.633193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59308fa-c97d-44a0-8302-5a401e0c671e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:18.649382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 49/98] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:18 2022] PUT /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/users/3e8eb57551f64caeac7429bc645c3ee4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:29:20.582783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17676-acb6-44f7-a076-ac8ac0a130a9 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.583316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17676-acb6-44f7-a076-ac8ac0a130a9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.583400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17676-acb6-44f7-a076-ac8ac0a130a9 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.586020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 50/99] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:20.595324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.595810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.595902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.625648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:20.626817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:20.695000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 50/100] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:20.720586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d17676-acb6-44f7-a076-ac8ac0a130a9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:20.735871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d17676-acb6-44f7-a076-ac8ac0a130a9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:20.741577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:20.742301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.742602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.742975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.756691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:20.763011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:29:20.764113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 51/101] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:29:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:20.770544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:20.784997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804aa4a2-8bbc-4223-9942-a819a588fe53 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:20.793040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:20.793969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.794390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.794838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.795954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:20.796402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:20.821779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:20.831276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 51/102] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:20.840432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:20.852481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719c22-a7bd-462f-baea-2c4c9a1730db admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:20.858246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:20.859398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.859717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.859989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.861226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:20.886794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:20.888283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 52/103] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:20 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:20.896498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:20.909334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be35f1-1282-41d1-87b7-a96fabc3e1b5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:20.915344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:20.915918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.916206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.916484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.924546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:20.949599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:20.958394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 52/104] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:20 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:20.966475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:20.977271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87eb02-6278-4bdd-be79-61c9098e010a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:20.982346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3187c7-81f6-434d-b0a6-9faa31fdcf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:20.983158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3187c7-81f6-434d-b0a6-9faa31fdcf83 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:20.983449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3187c7-81f6-434d-b0a6-9faa31fdcf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:20.983715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3187c7-81f6-434d-b0a6-9faa31fdcf83 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:20.984926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3187c7-81f6-434d-b0a6-9faa31fdcf83 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:21.010776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3187c7-81f6-434d-b0a6-9faa31fdcf83 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:21.012448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 53/105] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:20 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:29:21.018851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:21.032485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c74a1-d1fb-4377-9c60-80f2be224900 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:21.038227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:21.038839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:21.039133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:21.039412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:21.040197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6, user.id=3e8eb57551f64caeac7429bc645c3ee4) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:21.040504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:21.065823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35f31-7cf0-4f2b-ac8d-ae6af46a7d12 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:21.072372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 53/106] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:21 2022] GET /identity/v3/role_assignments?user.id=3e8eb57551f64caeac7429bc645c3ee4&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:23.100797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456ce3-2af4-40eb-bdfd-d6ad714aeb60 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.101686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456ce3-2af4-40eb-bdfd-d6ad714aeb60 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.101686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456ce3-2af4-40eb-bdfd-d6ad714aeb60 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.104467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 54/107] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:23.113024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.113431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.113649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.141987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:23.143213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:23.151764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 54/108] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:23.174039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456ce3-2af4-40eb-bdfd-d6ad714aeb60 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:23.187823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456ce3-2af4-40eb-bdfd-d6ad714aeb60 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:23.192603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:23.193349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.193642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.193932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.206002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:23.212619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:29:23.213725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 55/109] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:29:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:23.220280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:23.235265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43b914-df14-4652-9737-ccc377f48797 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:23.242223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:23.243252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.243727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.244195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.245339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:23.245802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:23.272632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:23.281341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 55/110] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:29:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:23.290139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:23.307338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26465c68-b168-493d-84be-7e7c2294da1f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:23.314912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:23.315708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.315993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.316268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.317583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:23.342926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:23.346104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 56/111] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:23 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:23.352655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:23.368016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1a58f-8a73-4e5e-85e5-1026f6201c45 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:23.376211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:23.376786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.377078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.377362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.385571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:23.410964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:23.420367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 56/112] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:23 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:23.426159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:23.436272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d4c9-5560-4e6a-b4db-a44f8eb7cd21 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:23.440826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ada4f0-f739-453b-8b5e-e429d077fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:23.441603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ada4f0-f739-453b-8b5e-e429d077fba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.441887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ada4f0-f739-453b-8b5e-e429d077fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.442169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ada4f0-f739-453b-8b5e-e429d077fba1 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.443274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ada4f0-f739-453b-8b5e-e429d077fba1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:23.469015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ada4f0-f739-453b-8b5e-e429d077fba1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:23.470666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 57/113] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:23 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:23.477030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:23.489359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7884fa-2fad-4118-815f-06ac4b0033d7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:23.494436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:23.495039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:23.495325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:23.495606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:23.496382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] RBAC: Adding query filter params (role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6, user.id=66682466934f4f93b7c7be98ff60c7c0) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:23.496693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:23.521878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78284a7-08c5-4deb-b35b-34aae3026dfe admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:23.528164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:23 2022] GET /identity/v3/role_assignments?user.id=66682466934f4f93b7c7be98ff60c7c0&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:25.452581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a206-698f-422b-a71d-f3f06e45e424 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.453220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a206-698f-422b-a71d-f3f06e45e424 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.453337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a206-698f-422b-a71d-f3f06e45e424 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.455091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 58/115] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:25.461570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.462254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.462458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.488550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:25.489699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:25.498884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 58/116] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:25.534452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a206-698f-422b-a71d-f3f06e45e424 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:25.555857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a206-698f-422b-a71d-f3f06e45e424 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:25.562772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:25.563491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.563781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.564063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.576149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:25.582800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:29:25.583926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 59/117] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:29:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:25.589650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:25.599449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c7c2-53b4-4bba-b581-597776fc9e75 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:25.605041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:25.605641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.605925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.606202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.607034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:25.607334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:25.632647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:25.641900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 59/118] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:29:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:25.650202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:25.662642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30722077-46e8-4dfc-a2af-8be99e6c858c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:25.666768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:25.667550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.667837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.668118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.669255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:25.694756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:25.696216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 60/119] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:25 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:25.702003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:25.712698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c74f-8e07-4962-8e58-90758df9a1e1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:25.718168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556613-2513-48c8-be7b-0b65b319fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:25.719166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556613-2513-48c8-be7b-0b65b319fa05 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.719392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556613-2513-48c8-be7b-0b65b319fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.719682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556613-2513-48c8-be7b-0b65b319fa05 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.720850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556613-2513-48c8-be7b-0b65b319fa05 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:25.746707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556613-2513-48c8-be7b-0b65b319fa05 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:25.748211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:25 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:25.756726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:25.769598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80901a10-9922-42f2-b1d3-30f76e606478 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:25.774892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a908d-016d-4656-80c2-35975b1c3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:25.775701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a908d-016d-4656-80c2-35975b1c3d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:25.775988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a908d-016d-4656-80c2-35975b1c3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:25.776272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a908d-016d-4656-80c2-35975b1c3d94 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/users/66682466934f4f93b7c7be98ff60c7c0/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:25.778961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a908d-016d-4656-80c2-35975b1c3d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3c0e728d554f76a7ce01429aa5c2d6, user_id=66682466934f4f93b7c7be98ff60c7c0, role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:25.805060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a908d-016d-4656-80c2-35975b1c3d94 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:25.821464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:25 2022] PUT /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/users/66682466934f4f93b7c7be98ff60c7c0/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:29:27.776098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4eb7-82af-45be-b742-ac290b795856 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:27.776647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4eb7-82af-45be-b742-ac290b795856 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:27.776647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4eb7-82af-45be-b742-ac290b795856 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:27.778358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 61/122] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:27.784905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:27.785646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:27.785772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:27.819277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:27.820418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:27.887342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 62/123] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:27.910204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4eb7-82af-45be-b742-ac290b795856 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:27.925100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4eb7-82af-45be-b742-ac290b795856 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:27.930138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:27.930900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:27.931192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:27.931481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:27.944792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:27.951496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:29:27.952581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:29:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:27.958755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:27.972692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b19d6-9fc1-4de1-bb57-c22e101678e2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:27.981503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:27.982415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:27.982875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:27.983295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:27.984369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:27.984674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:28.010138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:28.019204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:29:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:28.027891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:28.044174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04fa9-8dc0-40dc-9b38-d79f05a87f0f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:28.051077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:28.051869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:28.052160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:28.052442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:28.053733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:28.079506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:28.080951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:28 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:28.086925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:28.102450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd22776-ae56-4671-b2e4-1c8d936e4238 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:28.110486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:28.111097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:28.111389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:28.111670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:28.119732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:28.145730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:28.154999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:28 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:28.163915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:28.176621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d578a5e-990e-4d24-a9fd-07783160e384 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:28.181797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc448c-a9e6-4360-99ff-c7649dd5b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:28.182584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc448c-a9e6-4360-99ff-c7649dd5b6bb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:28.182905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc448c-a9e6-4360-99ff-c7649dd5b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:28.183185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc448c-a9e6-4360-99ff-c7649dd5b6bb admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:28.184404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc448c-a9e6-4360-99ff-c7649dd5b6bb admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:28.211410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc448c-a9e6-4360-99ff-c7649dd5b6bb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:28.214289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:28 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:28.223240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:28.237067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e948e4-fe98-4bb2-8153-9a472f9a7458 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:28.243073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:28.243658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:28.243946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:28.244230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:28.245018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] RBAC: Adding query filter params (role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6, user.id=66682466934f4f93b7c7be98ff60c7c0) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:28.245324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:28.270874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885d12e-b60d-4d94-97b0-c07bf02d73c0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:28.277182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:28 2022] GET /identity/v3/role_assignments?user.id=66682466934f4f93b7c7be98ff60c7c0&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:30.276469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa99df5-3e33-446a-b002-df3a1fdcdc32 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.277291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa99df5-3e33-446a-b002-df3a1fdcdc32 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.277291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa99df5-3e33-446a-b002-df3a1fdcdc32 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.280123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 65/130] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:30.289210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.289947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.290086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.317994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:30.319156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:30.328114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 66/131] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:30.362595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa99df5-3e33-446a-b002-df3a1fdcdc32 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:30.377223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa99df5-3e33-446a-b002-df3a1fdcdc32 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:30.382158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:30.382902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.383185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.383467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.395967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:30.402129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:30.403238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:30.409295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:30.422771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e291f-7d5b-48e1-b9f8-4015fa3fb592 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:30.428760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:30.429358 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.429649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.429932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.430685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:30.430970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:30.456355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:30.466492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:30.476764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:30.491140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a2c75-0d85-4bb8-b5e2-74c3270c8d56 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:30.496443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:30.497231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.497516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.497792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.499051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:30.524467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:30.525902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:30 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:29:30.532296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:30.547637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c35ec0-b9a8-4824-93be-824da319029b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:30.553576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:30.554151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.554444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.554770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.563591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:30.588988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:30.598464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 68/135] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:30.607682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:30.623693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e60bb2-456a-4d55-b6cf-a438a4754687 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:30.629924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d63fb-19c7-4a0f-ac31-9e375f743d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:30.630758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d63fb-19c7-4a0f-ac31-9e375f743d27 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.631049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d63fb-19c7-4a0f-ac31-9e375f743d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.631334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d63fb-19c7-4a0f-ac31-9e375f743d27 admin admin] PATH_INFO: `/v3/projects/e626ecc8864844ba9d60eaae271adc1d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.632638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d63fb-19c7-4a0f-ac31-9e375f743d27 admin admin] RBAC: Authorizing `identity:get_project(project_id=e626ecc8864844ba9d60eaae271adc1d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:30.658311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d63fb-19c7-4a0f-ac31-9e375f743d27 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:30.659859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 68/136] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:30 2022] GET /identity/v3/projects/e626ecc8864844ba9d60eaae271adc1d => generated 312 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:30.666174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:30.680334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f1e03-70f8-4dd8-bc68-bf4d6d9ee717 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:30.688409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:30.688982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:30.689273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:30.689551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:30.690334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] RBAC: Adding query filter params (role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=e626ecc8864844ba9d60eaae271adc1d, user.id=66682466934f4f93b7c7be98ff60c7c0) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:30.690667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:30.715833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b864a-d282-46e7-8d6e-3fb7562ba8da admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:30.721817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 69/137] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:30 2022] GET /identity/v3/role_assignments?user.id=66682466934f4f93b7c7be98ff60c7c0&scope.project.id=e626ecc8864844ba9d60eaae271adc1d&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:32.663481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bdd49-fd5f-4f57-9f8f-6fba8a9b905e None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.664029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bdd49-fd5f-4f57-9f8f-6fba8a9b905e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.664029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bdd49-fd5f-4f57-9f8f-6fba8a9b905e None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.665739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 69/138] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:32.672176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.672898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.673036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.708351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:32.709491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:32.716999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:32.745864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bdd49-fd5f-4f57-9f8f-6fba8a9b905e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:32.758849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bdd49-fd5f-4f57-9f8f-6fba8a9b905e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:32.763168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:32.763883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.764179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.764456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.777058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:32.783373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:32.784452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:32.790730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:32.802360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41dc98-f20c-4720-9a52-32b0143ade07 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:32.808284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:32.808879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.809171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.809453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.810171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:32.810469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:32.838798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:32.848307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 71/141] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:32.857546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:32.874941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a409f4-437b-4d82-a03f-c3901f021754 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:32.880473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:32.881267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.881555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.881837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.883104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:32.908624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:32.910067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 71/142] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:32 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:32.915500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:32.926076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd8a4-6731-44d8-9ab1-de26677d321b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:32.931964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9bc90-8535-4260-b205-abb6e2ce9a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:32.932750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bc90-8535-4260-b205-abb6e2ce9a16 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.933034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bc90-8535-4260-b205-abb6e2ce9a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.933317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9bc90-8535-4260-b205-abb6e2ce9a16 admin admin] PATH_INFO: `/v3/projects/e626ecc8864844ba9d60eaae271adc1d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.934600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9bc90-8535-4260-b205-abb6e2ce9a16 admin admin] RBAC: Authorizing `identity:get_project(project_id=e626ecc8864844ba9d60eaae271adc1d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:32.960613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9bc90-8535-4260-b205-abb6e2ce9a16 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:32.962126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 72/143] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:32 2022] GET /identity/v3/projects/e626ecc8864844ba9d60eaae271adc1d => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:32.967908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:32.983324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5dce4-aee1-48ab-9f43-3765d072a9aa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:32.992470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efb312-01c8-4a18-bb82-41095ebfd750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:32.993767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb312-01c8-4a18-bb82-41095ebfd750 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:32.994245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb312-01c8-4a18-bb82-41095ebfd750 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:32.994766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb312-01c8-4a18-bb82-41095ebfd750 admin admin] PATH_INFO: `/v3/projects/e626ecc8864844ba9d60eaae271adc1d/users/66682466934f4f93b7c7be98ff60c7c0/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:32.998122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb312-01c8-4a18-bb82-41095ebfd750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e626ecc8864844ba9d60eaae271adc1d, user_id=66682466934f4f93b7c7be98ff60c7c0, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:33.025495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb312-01c8-4a18-bb82-41095ebfd750 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:33.048105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 72/144] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:32 2022] PUT /identity/v3/projects/e626ecc8864844ba9d60eaae271adc1d/users/66682466934f4f93b7c7be98ff60c7c0/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:29:35.000703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989bd7-712b-46f3-8ec3-6885f8dd48a7 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.001594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989bd7-712b-46f3-8ec3-6885f8dd48a7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.001594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989bd7-712b-46f3-8ec3-6885f8dd48a7 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.004562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 73/145] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:35.010921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.011584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.011869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.038003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:35.039177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:35.110507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 73/146] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:35.133693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76989bd7-712b-46f3-8ec3-6885f8dd48a7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:35.154598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76989bd7-712b-46f3-8ec3-6885f8dd48a7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:35.160469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:35.161191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.161479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.161756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.176146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:35.182397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:35.183530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 74/147] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:35.189404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:35.198255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9633fa6-a971-4c54-9f22-9635fc8a3232 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:35.203453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:35.204059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.204347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.204629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.205347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:35.205647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:35.235101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:35.244889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:35.253320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:35.267850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f6ce-cb59-4f16-8880-ebe63aec282b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:35.275543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:35.276726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.277126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.277524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.279314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:35.305765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:35.307266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 75/149] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:35 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:35.313263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:35.329383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac841d-16da-425d-9f64-ca9b669edf7b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:35.338018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:35.338994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.339475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.339937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.350000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:35.375148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:35.384045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 75/150] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:35.393029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:35.408003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2e08c-6e6e-480c-b4a1-317414a44b83 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:35.413442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268723f9-5772-4a31-96a5-42453cbbf70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:35.414225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268723f9-5772-4a31-96a5-42453cbbf70d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.414515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268723f9-5772-4a31-96a5-42453cbbf70d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.414822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268723f9-5772-4a31-96a5-42453cbbf70d admin admin] PATH_INFO: `/v3/projects/e626ecc8864844ba9d60eaae271adc1d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.416124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268723f9-5772-4a31-96a5-42453cbbf70d admin admin] RBAC: Authorizing `identity:get_project(project_id=e626ecc8864844ba9d60eaae271adc1d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:35.441896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268723f9-5772-4a31-96a5-42453cbbf70d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:35.443461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:35 2022] GET /identity/v3/projects/e626ecc8864844ba9d60eaae271adc1d => generated 312 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:35.449996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:35.460243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e4d95-a602-49f5-bce6-8496d6ec395b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:35.465609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:35.466186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:35.466473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:35.466792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:35.467575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] RBAC: Adding query filter params (role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=e626ecc8864844ba9d60eaae271adc1d, user.id=66682466934f4f93b7c7be98ff60c7c0) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:35.467901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:35.493772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09728-1b2f-4031-9ad9-9ac163468c2d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:35.500214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 76/152] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:35 2022] GET /identity/v3/role_assignments?user.id=66682466934f4f93b7c7be98ff60c7c0&scope.project.id=e626ecc8864844ba9d60eaae271adc1d&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:37.523377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cb5aa-3a95-41b8-9855-5e5236cb60f4 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:37.524199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cb5aa-3a95-41b8-9855-5e5236cb60f4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:37.524310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cb5aa-3a95-41b8-9855-5e5236cb60f4 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:37.527010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 77/153] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:37.532423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbd77-247b-4690-abb8-d506923d581d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:37.532846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbd77-247b-4690-abb8-d506923d581d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:37.532968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbd77-247b-4690-abb8-d506923d581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:37.555826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-029bbd77-247b-4690-abb8-d506923d581d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:37.556966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-029bbd77-247b-4690-abb8-d506923d581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:37.565127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 77/154] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:37.587760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cb5aa-3a95-41b8-9855-5e5236cb60f4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:37.602187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cb5aa-3a95-41b8-9855-5e5236cb60f4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:37.607245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edebf5e-b451-48b8-b113-e880f65cba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:37.607952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebf5e-b451-48b8-b113-e880f65cba92 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:37.608237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebf5e-b451-48b8-b113-e880f65cba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:37.608520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edebf5e-b451-48b8-b113-e880f65cba92 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:37.610038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edebf5e-b451-48b8-b113-e880f65cba92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:37.635679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edebf5e-b451-48b8-b113-e880f65cba92 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:37.637115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 78/155] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:29:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:37.643750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbd77-247b-4690-abb8-d506923d581d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:37.657379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbd77-247b-4690-abb8-d506923d581d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:37.662938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd6a2f-38cd-4495-aa15-7dcb6a0878ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:37.663530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6a2f-38cd-4495-aa15-7dcb6a0878ff admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:37.663818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6a2f-38cd-4495-aa15-7dcb6a0878ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:37.664093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd6a2f-38cd-4495-aa15-7dcb6a0878ff admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:37.664746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd6a2f-38cd-4495-aa15-7dcb6a0878ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:37.690709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd6a2f-38cd-4495-aa15-7dcb6a0878ff admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:37.720378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 78/156] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:29:37 2022] POST /identity/v3/projects => generated 302 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:29:39.743241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516507b6-8252-4e81-8c1e-1c5da9f71936 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:39.743792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516507b6-8252-4e81-8c1e-1c5da9f71936 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:39.743792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516507b6-8252-4e81-8c1e-1c5da9f71936 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:39.745484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 79/157] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:39.751521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:39.751940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:39.752082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:39.781854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:39.783057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:39.848905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:39.878609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516507b6-8252-4e81-8c1e-1c5da9f71936 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:39.892193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516507b6-8252-4e81-8c1e-1c5da9f71936 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:39.896861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd0e23-e5bf-48d8-a82f-4c6d7b0cbe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:39.897590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd0e23-e5bf-48d8-a82f-4c6d7b0cbe20 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:39.897880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd0e23-e5bf-48d8-a82f-4c6d7b0cbe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:39.898161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd0e23-e5bf-48d8-a82f-4c6d7b0cbe20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:39.899271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd0e23-e5bf-48d8-a82f-4c6d7b0cbe20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:39.925527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd0e23-e5bf-48d8-a82f-4c6d7b0cbe20 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:39.927015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 80/159] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:39.932895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:39.943895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde706b9-7220-4364-90ff-a7be41debc53 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:39.949901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4cbf-e562-4ff5-9cca-08400550146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:39.950501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4cbf-e562-4ff5-9cca-08400550146d admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:39.950819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4cbf-e562-4ff5-9cca-08400550146d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:39.951099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4cbf-e562-4ff5-9cca-08400550146d admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:39.951746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f4cbf-e562-4ff5-9cca-08400550146d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:39.977514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f4cbf-e562-4ff5-9cca-08400550146d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:40.001111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 80/160] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:29:39 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:29:41.992283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746bbc4-72f8-4723-b602-0c1db4484147 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:41.993261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746bbc4-72f8-4723-b602-0c1db4484147 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:41.993261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746bbc4-72f8-4723-b602-0c1db4484147 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:41.995958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 81/161] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:42.002114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.002578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.002767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.027480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:42.028618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:42.036380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 81/162] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:42.058950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746bbc4-72f8-4723-b602-0c1db4484147 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:42.075054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746bbc4-72f8-4723-b602-0c1db4484147 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:42.081674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:42.082774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.083165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.083566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.100842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:42.107151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:42.108296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:42.114617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:42.127146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c7e79-725b-43db-aac2-822ac5a318bf None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:42.132700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:42.133294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.133577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.133856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.134592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:42.134903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:42.160395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:42.169786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:42.175996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:42.189997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453e74-da50-4aaa-b63e-5d79829ae556 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:42.194359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:42.195179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.195464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.195737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.215259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:42.241762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:42.243446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:42 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:42.249721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:42.267796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11eec9-f1b5-4553-86c5-4b6b5157cc8d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:42.273805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:42.274380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.274707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.274986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.283414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:42.308751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:42.317404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 83/166] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:42.326300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:42.336989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56118de0-9bd5-422a-bc2e-d97c59997a86 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:42.341551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949b6d4-fc38-4261-a386-13637e010796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:42.342343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b6d4-fc38-4261-a386-13637e010796 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.342668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b6d4-fc38-4261-a386-13637e010796 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.342956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949b6d4-fc38-4261-a386-13637e010796 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.344076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949b6d4-fc38-4261-a386-13637e010796 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:42.369998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949b6d4-fc38-4261-a386-13637e010796 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:42.371545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:42 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:42.378067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:42.391968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a2c93-1a0c-432c-8fc3-fe4b1eb4f4f1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:42.396608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:42.397181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:42.397463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:42.397747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:42.398520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] RBAC: Adding query filter params (role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=135c7b26eb2e41df8d28464867dd66a8, user.id=11cf6778ae894671b342e50ddfb59bb3) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:42.398857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:42.424142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f074669-27d6-4fe2-9821-aba7ca500273 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:42.429919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:42 2022] GET /identity/v3/role_assignments?user.id=11cf6778ae894671b342e50ddfb59bb3&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:44.379712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026603-fa8d-4274-b2dc-5f8f0cfac413 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.380252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026603-fa8d-4274-b2dc-5f8f0cfac413 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.380252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06026603-fa8d-4274-b2dc-5f8f0cfac413 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.381972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 85/169] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:44.388319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.389057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.389180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.419718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:44.420851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:44.429587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:44.461756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06026603-fa8d-4274-b2dc-5f8f0cfac413 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:44.473694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06026603-fa8d-4274-b2dc-5f8f0cfac413 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:44.478339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:44.479091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.479370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.479657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.492522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:44.498822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:44.499904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 86/171] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:44.506627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:44.519528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e55fe2-c9d2-48d2-a45b-630d37edfee1 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:44.525343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:44.525937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.526230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.526506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.527263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:44.527560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:44.553037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:44.565757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:44.575011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:44.587145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4a5ef-45c6-4abf-9742-bcd5adf3a18f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:44.592775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:44.593600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.593866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.594145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.595477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:44.622599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:44.624102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 87/173] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:44 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:44.630385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:44.644037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075910ba-5261-4897-9199-172d88b4acdb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:44.649874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18db0d-6d99-4606-afe6-df1d9f17b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:44.650689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18db0d-6d99-4606-afe6-df1d9f17b1eb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.650973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18db0d-6d99-4606-afe6-df1d9f17b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.651248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18db0d-6d99-4606-afe6-df1d9f17b1eb admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.652540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18db0d-6d99-4606-afe6-df1d9f17b1eb admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:44.678149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18db0d-6d99-4606-afe6-df1d9f17b1eb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:44.679751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 87/174] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:44 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:44.688871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:44.703955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24823d-ac49-44a0-bc24-62641d2f0360 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:44.709597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624fd53-946c-4df4-8df3-878a02942f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:44.710420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624fd53-946c-4df4-8df3-878a02942f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:44.710751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624fd53-946c-4df4-8df3-878a02942f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:44.711033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624fd53-946c-4df4-8df3-878a02942f82 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8/users/11cf6778ae894671b342e50ddfb59bb3/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:44.713125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624fd53-946c-4df4-8df3-878a02942f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135c7b26eb2e41df8d28464867dd66a8, user_id=11cf6778ae894671b342e50ddfb59bb3, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:44.739933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624fd53-946c-4df4-8df3-878a02942f82 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:44.757994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 88/175] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:44 2022] PUT /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8/users/11cf6778ae894671b342e50ddfb59bb3/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:29:46.710105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb4ad8-391d-4421-a588-16bfdcf67656 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:46.711040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb4ad8-391d-4421-a588-16bfdcf67656 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:46.711040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb4ad8-391d-4421-a588-16bfdcf67656 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:46.713750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 88/176] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:46.719987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:46.720676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:46.720883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:46.749576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:46.751087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:46.819670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 89/177] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:46.845281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb4ad8-391d-4421-a588-16bfdcf67656 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:46.858940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb4ad8-391d-4421-a588-16bfdcf67656 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:46.865098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:46.866427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:46.866752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:46.867034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:46.883301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:46.891427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:29:46.892593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 89/178] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:46.900418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:46.910318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5deb44-a2b5-4059-96de-54407eacdb6d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:46.914818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:46.915462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:46.915721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:46.916004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:46.916750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:46.917048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:46.942840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:46.954624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 90/179] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:29:46.959399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:46.969129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d79b-a87b-4ca8-8945-914db283893b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:46.975486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:46.976301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:46.976590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:46.976868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:46.977971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:47.009124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:47.010810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 90/180] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:46 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:29:47.017656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:47.028060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539061f-67fc-4fb2-9b1b-107bfcf7f7e5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:47.032062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:47.032679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:47.032968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:47.033253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:47.041414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:47.067179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:47.076330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 91/181] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:47 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:47.082675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:47.091868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d30f-cb05-40b1-895c-5393180dffd0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:47.096151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d3fb2-14bd-4c0f-a30d-b1898f45ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:47.096908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d3fb2-14bd-4c0f-a30d-b1898f45ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:47.097225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d3fb2-14bd-4c0f-a30d-b1898f45ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:47.097505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d3fb2-14bd-4c0f-a30d-b1898f45ae0c admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:47.098628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d3fb2-14bd-4c0f-a30d-b1898f45ae0c admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:47.124633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d3fb2-14bd-4c0f-a30d-b1898f45ae0c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:47.126317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:47 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:47.133101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:47.147362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4af58-e101-4e72-be8a-026bb41346ca admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:47.155748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:47.156511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:47.156760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:47.157038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:47.157825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] RBAC: Adding query filter params (role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=135c7b26eb2e41df8d28464867dd66a8, user.id=11cf6778ae894671b342e50ddfb59bb3) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:47.158124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:47.183691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb414e4-268b-4491-8d9b-5e364fb05e85 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:47.189609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:47 2022] GET /identity/v3/role_assignments?user.id=11cf6778ae894671b342e50ddfb59bb3&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:49.187426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93a104-d2df-445d-a85a-9688fe3c1528 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.187964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93a104-d2df-445d-a85a-9688fe3c1528 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.188105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93a104-d2df-445d-a85a-9688fe3c1528 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.189987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 92/184] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:49.196132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.196579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.196714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.223087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:49.224573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:49.235757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 93/185] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:49.258621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93a104-d2df-445d-a85a-9688fe3c1528 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:49.274688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93a104-d2df-445d-a85a-9688fe3c1528 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:49.280286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:49.280883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.281231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.281538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.293082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:49.299393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:29:49.300519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:49.309516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:49.324575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8f645-9fa3-4191-9799-b22009ac7d7c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:49.332593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:49.333521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.333915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.334278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.335432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:49.335856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:49.364972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:49.373581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:49.382389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:49.399586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd027a89-54e2-42c4-bb0e-838adaf30e46 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:49.407571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:49.408802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.409256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.409675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.411645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:49.447083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:49.448484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:49 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:49.456900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:49.470880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acee2d-de66-4e05-bf00-8de97516a6dc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:49.481450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:49.482038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.482422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.482746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.491688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:49.518441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:49.528376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 95/189] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:49.535037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:49.551411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bf9ab-c064-4dfb-b499-b87a0fa04432 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:49.559502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb24f6-f0d0-4943-aec2-b304835215f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:49.560757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb24f6-f0d0-4943-aec2-b304835215f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.561237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb24f6-f0d0-4943-aec2-b304835215f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.561702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb24f6-f0d0-4943-aec2-b304835215f1 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.563212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb24f6-f0d0-4943-aec2-b304835215f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:49.588725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb24f6-f0d0-4943-aec2-b304835215f1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:49.590267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:49 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:49.599787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:49.614166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5df0b-04dc-437a-9eaf-29f37ef747e7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:49.621997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:49.622959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:49.623423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:49.623878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:49.625165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=135c7b26eb2e41df8d28464867dd66a8, user.id=3e8eb57551f64caeac7429bc645c3ee4) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:49.625489 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:49.650992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b88308-1c61-408c-8d96-4d8c63eb6110 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:49.657137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:49 2022] GET /identity/v3/role_assignments?user.id=3e8eb57551f64caeac7429bc645c3ee4&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:51.644557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bb76-dbaa-4387-8b12-ad47fc8d5244 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.645112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bb76-dbaa-4387-8b12-ad47fc8d5244 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.645112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972bb76-dbaa-4387-8b12-ad47fc8d5244 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.646897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 96/192] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:51.652360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.652771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.652913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.677274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:51.678410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:51.686994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 97/193] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:51.708714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bb76-dbaa-4387-8b12-ad47fc8d5244 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:51.722329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972bb76-dbaa-4387-8b12-ad47fc8d5244 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:51.727697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:51.728405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.728695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.728976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.740938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:51.747159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:29:51.748267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:51.753918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:51.762621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3602f2f-b21e-4753-8a7e-ab28db680e3b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:51.767542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:51.768134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.768417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.768703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.769425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:51.769727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:51.795063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:51.804031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:51.809858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:51.821305 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5fd96-a56c-437d-baea-280148786696 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:51.826464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:51.827291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.827579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.827930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.829112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:51.854907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:51.856360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:51 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:51.864804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:51.878396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d945-6f11-45da-9f0b-017decb50913 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:51.883431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0fe3f-e500-4906-b4a3-ab23eb23cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:51.884228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fe3f-e500-4906-b4a3-ab23eb23cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.884516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fe3f-e500-4906-b4a3-ab23eb23cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.884794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fe3f-e500-4906-b4a3-ab23eb23cc6b admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.886093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fe3f-e500-4906-b4a3-ab23eb23cc6b admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:51.912013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fe3f-e500-4906-b4a3-ab23eb23cc6b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:51.913513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 99/197] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:51 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:51.919793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:51.930648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d640b-e03b-4d18-8908-f28b13d5534d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:51.935795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd503408-c096-4e11-94ff-b3b96f8a6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:51.936635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd503408-c096-4e11-94ff-b3b96f8a6d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:51.936922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd503408-c096-4e11-94ff-b3b96f8a6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:51.937252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd503408-c096-4e11-94ff-b3b96f8a6d2a admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8/users/3e8eb57551f64caeac7429bc645c3ee4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:51.939163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd503408-c096-4e11-94ff-b3b96f8a6d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=135c7b26eb2e41df8d28464867dd66a8, user_id=3e8eb57551f64caeac7429bc645c3ee4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:51.965122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd503408-c096-4e11-94ff-b3b96f8a6d2a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:51.982531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 99/198] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:51 2022] PUT /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8/users/3e8eb57551f64caeac7429bc645c3ee4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:29:53.995554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89572e-7bca-4971-a739-add1849ac25f None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:53.996103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89572e-7bca-4971-a739-add1849ac25f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:53.996103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89572e-7bca-4971-a739-add1849ac25f None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:53.997793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 100/199] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:54.004170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.004980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.005191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.041559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:54.042736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:54.111272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 100/200] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:54.138206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89572e-7bca-4971-a739-add1849ac25f None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:54.152932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89572e-7bca-4971-a739-add1849ac25f None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:54.159345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:54.161733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.162038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.162326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.180199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:54.186476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:29:54.187644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:54.193697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:54.202804 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea4062-6e2a-446d-95a9-db552e93dbba None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:54.207325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:54.207922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.208206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.208483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.209198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:54.209495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:54.234868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:54.244371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:29:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:54.250887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:54.265895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c569e3-9d23-42fd-b95a-b083562f2f5b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:54.270962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:54.271762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.272047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.272321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.273557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:54.299039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:54.300507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:54 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:54.309048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:54.328999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edee8b-de24-495c-ab85-cc2ec10f8cb7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:54.333776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:54.334363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.334678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.334955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.343949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:54.369446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:54.378642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 102/204] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:54 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:54.385444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:54.397188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c053cdc-617a-4dc9-a0b1-9ff5f2d16e24 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:54.402246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdb06a-6f91-47c1-aae4-dfc63e7e5223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:54.403085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb06a-6f91-47c1-aae4-dfc63e7e5223 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.403369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb06a-6f91-47c1-aae4-dfc63e7e5223 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.403649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdb06a-6f91-47c1-aae4-dfc63e7e5223 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.404963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdb06a-6f91-47c1-aae4-dfc63e7e5223 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:54.430454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdb06a-6f91-47c1-aae4-dfc63e7e5223 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:54.432023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:54 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:54.441598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:54.454925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ffde-b83e-4f99-be2e-35fd34815017 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:54.460033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:54.460617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:54.460903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:54.461181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:54.461967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=135c7b26eb2e41df8d28464867dd66a8, user.id=3e8eb57551f64caeac7429bc645c3ee4) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:54.462268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:54.488016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6c81c-7d6f-4f10-a796-d551c0e2f465 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:54.494274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 103/206] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:54 2022] GET /identity/v3/role_assignments?user.id=3e8eb57551f64caeac7429bc645c3ee4&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:56.485161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e250-09b0-4bc6-a130-4cf346004f73 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.485956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e250-09b0-4bc6-a130-4cf346004f73 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.485956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e250-09b0-4bc6-a130-4cf346004f73 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.488643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 104/207] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:56.494809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.495505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.495642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.526530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:56.527719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:56.535897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 104/208] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:56.558852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e250-09b0-4bc6-a130-4cf346004f73 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:56.579357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e250-09b0-4bc6-a130-4cf346004f73 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:56.584566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:56.585301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.585584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.585896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.599727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:56.606369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:29:56.607506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 105/209] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:29:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:56.616357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:56.630626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d66ca-cc6d-4e97-90a6-704202d3bb13 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:56.639026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:56.639937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.640359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.640641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.641353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:56.641652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:56.666927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:56.676164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 105/210] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:29:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:56.682831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:56.694733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e56b9-0829-46b9-b37d-7e2af622bf90 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:56.702840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:56.704106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.704582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.705069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.706287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:56.732196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:56.733720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 106/211] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:56 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:56.740538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:56.755719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a6ab0-f8fe-4312-8c6e-b7990d552890 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:56.765527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:56.766448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.766897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.767188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.775632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:56.801476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:56.810613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 106/212] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:29:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:29:56.817053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:56.826806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615465f-bfe5-4732-bba9-e04ed0fd4c4f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:56.831029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb84b74-0294-4320-83dd-310adef36508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:56.831801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84b74-0294-4320-83dd-310adef36508 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.832083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84b74-0294-4320-83dd-310adef36508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.832360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb84b74-0294-4320-83dd-310adef36508 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.833488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb84b74-0294-4320-83dd-310adef36508 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:56.861898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb84b74-0294-4320-83dd-310adef36508 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:56.863606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 107/213] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:56 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:56.870364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:56.883952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef3e6-8954-430a-847b-53333edc3309 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:56.890880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:56.891748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:56.892135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:56.892505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:56.893711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] RBAC: Adding query filter params (role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=135c7b26eb2e41df8d28464867dd66a8, user.id=11cf6778ae894671b342e50ddfb59bb3) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:56.894137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:56.922041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404da003-f3c9-48f9-888f-9f0fd1b38ef2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:56.927976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 107/214] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:29:56 2022] GET /identity/v3/role_assignments?user.id=11cf6778ae894671b342e50ddfb59bb3&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:58.981506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9266-edbc-4d44-8e51-e198bf9cd7fd None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:58.982330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9266-edbc-4d44-8e51-e198bf9cd7fd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:58.982330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b9266-edbc-4d44-8e51-e198bf9cd7fd None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:58.984846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 108/215] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:29:58.990347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:58.990768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:58.990946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:59.017298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:29:59.018423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:29:59.027080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 108/216] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:29:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:29:59.049276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9266-edbc-4d44-8e51-e198bf9cd7fd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:59.063414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b9266-edbc-4d44-8e51-e198bf9cd7fd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:59.068445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:59.069170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:59.069460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:59.069732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:59.081812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:29:59.088491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:29:59.089564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 109/217] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:29:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:29:59.096002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:59.110625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411eb5c-06bd-488e-b394-7567ca36b1b0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:59.126943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:59.127548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:59.127835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:59.128115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:59.128836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:29:59.129155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:59.154432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:59.164442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 109/218] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:29:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:59.170949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:59.181907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63255a8-9fbc-4779-a78f-c9c2b76e835d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:59.187262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:59.188065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:59.188350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:59.188631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:59.189856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:59.215424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:59.216961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 110/219] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:29:59 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:59.223621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:59.239492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43e24-51a1-43a8-9f59-fafb378f6a70 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:59.247149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259eebe-6cad-40df-9d2d-a01b9dacf9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:59.248421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259eebe-6cad-40df-9d2d-a01b9dacf9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:59.248824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259eebe-6cad-40df-9d2d-a01b9dacf9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:59.249306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259eebe-6cad-40df-9d2d-a01b9dacf9f4 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:59.250930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259eebe-6cad-40df-9d2d-a01b9dacf9f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:59.276271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259eebe-6cad-40df-9d2d-a01b9dacf9f4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:59.277819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 110/220] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:29:59 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:29:59.285450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:29:59.301350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b67b2-7442-45b1-81cd-12939ef700c9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:29:59.309191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df8c57-e0f5-4bd7-94cd-77771c4ccff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:29:59.310504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df8c57-e0f5-4bd7-94cd-77771c4ccff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:29:59.311040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df8c57-e0f5-4bd7-94cd-77771c4ccff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:29:59.311511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df8c57-e0f5-4bd7-94cd-77771c4ccff3 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8/users/11cf6778ae894671b342e50ddfb59bb3/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:29:59.313996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df8c57-e0f5-4bd7-94cd-77771c4ccff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135c7b26eb2e41df8d28464867dd66a8, user_id=11cf6778ae894671b342e50ddfb59bb3, role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:29:59.340061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df8c57-e0f5-4bd7-94cd-77771c4ccff3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:29:59.356855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 111/221] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:29:59 2022] PUT /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8/users/11cf6778ae894671b342e50ddfb59bb3/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:01.329968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0a5dd-0caf-4c1b-8d59-916ffabe029f None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.330531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0a5dd-0caf-4c1b-8d59-916ffabe029f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.330531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0a5dd-0caf-4c1b-8d59-916ffabe029f None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.332267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 111/222] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:30:01.338607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.339315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.339591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.366067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:01.367263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:01.434838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 112/223] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:01.470677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0a5dd-0caf-4c1b-8d59-916ffabe029f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:01.485464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0a5dd-0caf-4c1b-8d59-916ffabe029f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:01.490535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:01.491289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.491575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.491852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.505528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:01.512157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:01.513235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 112/224] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:01.519477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:01.533128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f2f85-0f48-404b-8dc7-e177fbe4efe8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:01.539601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:01.540296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.540587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.540894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.541619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:01.541922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:01.567650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:01.577162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:01.585810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:01.599406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a69aa-239e-4b59-ab0f-b3c81cc52a5d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:01.604866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:01.605658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.605947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.606225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.607506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:01.633175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:01.634613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:30:01 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:01.639985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:01.653736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e6872-5dd9-438d-9b6b-710d0aff18e9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:01.660492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:01.661062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.661345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.661622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.669788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:01.695494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:01.704416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 114/227] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:01 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:01.713173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:01.729380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7056-05ef-45e0-80a0-cc92a9d259bb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:01.736649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecd93-8b22-4ae6-b030-dea9a20098aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:01.737413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecd93-8b22-4ae6-b030-dea9a20098aa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.737701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecd93-8b22-4ae6-b030-dea9a20098aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.737970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecd93-8b22-4ae6-b030-dea9a20098aa admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.739314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecd93-8b22-4ae6-b030-dea9a20098aa admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:01.764959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecd93-8b22-4ae6-b030-dea9a20098aa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:01.766693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:01 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:01.776028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:01.791240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96e51-6445-4dfe-9caa-240e7fcf500f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:01.799224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:01.799785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:01.800067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:01.800342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:01.801117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] RBAC: Adding query filter params (role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=135c7b26eb2e41df8d28464867dd66a8, user.id=11cf6778ae894671b342e50ddfb59bb3) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:01.801421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:01.828611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff579a-1df1-4460-9521-c1c51526ac22 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:01.835433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:30:01 2022] GET /identity/v3/role_assignments?user.id=11cf6778ae894671b342e50ddfb59bb3&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 608 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:03.893189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c891c-77d1-44a7-a2bd-e436907b212a None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:03.894031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c891c-77d1-44a7-a2bd-e436907b212a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:03.894179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c891c-77d1-44a7-a2bd-e436907b212a None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:03.896812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 115/230] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:03.905471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:03.906129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:03.906476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:03.936441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:03.937728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:03.945968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 116/231] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:03.970461 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c891c-77d1-44a7-a2bd-e436907b212a None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:03.985683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c891c-77d1-44a7-a2bd-e436907b212a None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:03.991231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc1aeb-265f-4349-93a0-426fb84cdb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:03.991953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc1aeb-265f-4349-93a0-426fb84cdb9a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:03.992220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc1aeb-265f-4349-93a0-426fb84cdb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:03.992526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc1aeb-265f-4349-93a0-426fb84cdb9a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:03.993662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc1aeb-265f-4349-93a0-426fb84cdb9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:04.019325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc1aeb-265f-4349-93a0-426fb84cdb9a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:04.020788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 116/232] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:04.027290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:04.041413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d12a3-3515-48d7-8cbb-04aac4fdf4b1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:04.049481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:04.050396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:04.050908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:04.051366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] PATH_INFO: `/v3/groups` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:04.052339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:04.087223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:04.087223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:30:04.087223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:30:04.088391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2192c0e-63d1-4a1b-968b-85f04419eebd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:04.110016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 117/233] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Feb 28 18:30:04 2022] POST /identity/v3/groups => generated 229 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:30:06.096983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771045-a942-4408-90ab-534ff2e3f29b None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:06.097524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771045-a942-4408-90ab-534ff2e3f29b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:06.097609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4771045-a942-4408-90ab-534ff2e3f29b None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:06.100551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 117/234] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:06.108540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:06.109044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:06.109130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:06.132712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:06.133826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:06.141613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 118/235] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:30:06.169246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771045-a942-4408-90ab-534ff2e3f29b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:06.182853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4771045-a942-4408-90ab-534ff2e3f29b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:06.187741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4656-7685-4132-b788-e730086f2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:06.188438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4656-7685-4132-b788-e730086f2e96 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:06.188726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4656-7685-4132-b788-e730086f2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:06.189003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4656-7685-4132-b788-e730086f2e96 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:06.190096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4656-7685-4132-b788-e730086f2e96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:06.215150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4656-7685-4132-b788-e730086f2e96 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:06.216638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 118/236] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:06.222219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:06.231271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b36f6-6139-4dae-9728-5ec1efcbd49b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:06.236441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93171fc-5fd2-4ff1-a9bd-755c29924602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:06.237033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93171fc-5fd2-4ff1-a9bd-755c29924602 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:06.237320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93171fc-5fd2-4ff1-a9bd-755c29924602 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:06.237610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93171fc-5fd2-4ff1-a9bd-755c29924602 admin admin] PATH_INFO: `/v3/groups` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:06.238254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93171fc-5fd2-4ff1-a9bd-755c29924602 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:06.263939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93171fc-5fd2-4ff1-a9bd-755c29924602 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:06.284365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 119/237] 10.222.0.18 () {60 vars in 1155 bytes} [Mon Feb 28 18:30:06 2022] POST /identity/v3/groups => generated 226 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:30:08.252758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508fa66-a1e2-43e0-8494-7b3889599335 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.253520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508fa66-a1e2-43e0-8494-7b3889599335 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.253654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508fa66-a1e2-43e0-8494-7b3889599335 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.256381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 119/238] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:08.261768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.262178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.262340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.286048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:08.287203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:08.295065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:08.317860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508fa66-a1e2-43e0-8494-7b3889599335 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:08.339294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508fa66-a1e2-43e0-8494-7b3889599335 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:08.346295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:08.347036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.347317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.347596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.361324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:08.367579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:30:08.368647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 120/240] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:08.374270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:08.383666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e059-51e5-46bd-8f90-7cc54d990b0c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:08.388984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:08.389592 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.389879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.390200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.390955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:08.391257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:08.416764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:08.426589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 121/241] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:30:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:08.432998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:08.449249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db31644-0a13-40ff-85d6-bb93c38dca4a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:08.456109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:08.456686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.456966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.457240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.465403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:08.491582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:08.500792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 121/242] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:08.509403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:08.521929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a13534-3240-4c57-9eab-dfcf5d0e75bc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:08.527891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:08.528667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.528955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.529232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.530540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:08.556412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:08.557905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 122/243] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:08 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:08.564103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:08.578159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a969ea-f379-4ecd-add6-321aeb2d8aa8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:08.583940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:08.584700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.584978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.585249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.591358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:08.616269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:08.616269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:30:08.616269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:30:08.617419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce7a8a-2adf-42d1-a7c3-39ce9079a2eb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:08.618879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 122/244] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:08 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:08.627916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:08.642712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f492e-472e-4345-81e7-0b237dee4de0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:08.648766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:08.649335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:08.649624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:08.649906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:08.650720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:08.651028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:08.676420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714bf9-b14a-44c0-beb2-23850db8a135 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:08.682223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 123/245] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:08 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 260 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:10.675761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893f58-adbb-4d31-890b-45423582cf2e None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:10.676930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893f58-adbb-4d31-890b-45423582cf2e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:10.676930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893f58-adbb-4d31-890b-45423582cf2e None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:10.679391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 123/246] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:10.688079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:10.688757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:10.689010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:10.717645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:10.718848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:10.726793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 124/247] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:10.749554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893f58-adbb-4d31-890b-45423582cf2e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:10.769092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893f58-adbb-4d31-890b-45423582cf2e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:10.775027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:10.775730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:10.776012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:10.776280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:10.789836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:10.797934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:30:10.799037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 124/248] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:10.807574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:10.821441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a27d7-18a0-4470-a3b7-252ec0ae0c29 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:10.828197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:10.828876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:10.829159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:10.829437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:10.830164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:10.830469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:10.855827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:10.865196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 125/249] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:30:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:10.871230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:10.888577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bc55d-1c9d-42af-9956-3cd3f3ce324d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:10.895185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:10.895943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:10.896222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:10.896491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:10.897755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:10.923045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:10.924440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 125/250] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:10 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:10.933311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:10.949306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4ece1-5d01-43a6-a733-c779da72c732 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:10.956403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9ba4-156a-419e-a898-db0a2c053a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:10.957180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9ba4-156a-419e-a898-db0a2c053a81 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:10.957470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9ba4-156a-419e-a898-db0a2c053a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:10.957751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9ba4-156a-419e-a898-db0a2c053a81 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:10.959076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9ba4-156a-419e-a898-db0a2c053a81 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:10.984925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9ba4-156a-419e-a898-db0a2c053a81 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:10.986434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 126/251] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:10 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:10.992492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:11.007481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f2411-0440-4c81-941e-51f53a8377d0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:11.015911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69f3b6-59bb-4661-bb92-ec5e053f4f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:11.016839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f3b6-59bb-4661-bb92-ec5e053f4f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:11.017120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f3b6-59bb-4661-bb92-ec5e053f4f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:11.017396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69f3b6-59bb-4661-bb92-ec5e053f4f83 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:11.019557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69f3b6-59bb-4661-bb92-ec5e053f4f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3c0e728d554f76a7ce01429aa5c2d6, group_id=5bedff74ba7948b89e57a4b3a7b90955, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:11.045655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69f3b6-59bb-4661-bb92-ec5e053f4f83 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:11.064060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 126/252] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Feb 28 18:30:10 2022] PUT /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:13.134237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378ec8-c9f8-47d0-af18-5d4bb8759205 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.134857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378ec8-c9f8-47d0-af18-5d4bb8759205 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.134857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378ec8-c9f8-47d0-af18-5d4bb8759205 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.136835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 127/253] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:13.142919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.143377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.143489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.171588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:13.172924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:13.243201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 127/254] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:13.266110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378ec8-c9f8-47d0-af18-5d4bb8759205 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:13.283720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378ec8-c9f8-47d0-af18-5d4bb8759205 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:13.288951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:13.289675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.289959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.290238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.302924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:13.309510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:30:13.310598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 128/255] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:13.317123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:13.330523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c600b-dcce-4d98-9ee8-3205cd7d2921 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:13.338705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:13.339602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.340022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.340484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.341602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:13.342055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:13.368260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:13.377782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 128/256] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:30:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:30:13.386923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:13.401132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f98d2-bfda-4c7c-ac5c-84a9987a66ff admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:13.407006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:13.407582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.407867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.408142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.417100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:13.442379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:13.452228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 129/257] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:13 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:13.458841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:13.472280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b07856-d931-4fa1-9f87-7fa807a1cf34 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:13.477796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:13.478588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.478901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.479180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.480481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:13.506332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:13.507912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 129/258] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:13 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:13.514820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:13.527458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2f0b2-d1c7-46f4-83b9-49337e9049c1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:13.533981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:13.534791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.535075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.535350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.536413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:13.561299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:13.561299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:30:13.561299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:30:13.562705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd7bf4-1f01-47f9-931d-2dacdfa7801f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:13.564041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 130/259] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:13 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:13.570275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:13.585544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5180cd-0bf8-40c4-b2e9-a0e3068c7e6c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:13.592854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:13.594042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:13.594176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:13.594469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:13.595283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:13.595588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:13.621469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cdad1-482a-40b9-9cd9-3b7432a0be01 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:13.627819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 130/260] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:13 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 611 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:30:15.600973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafc9d-7882-4caa-bfe9-36f668ab3b47 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.601853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafc9d-7882-4caa-bfe9-36f668ab3b47 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.601853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafc9d-7882-4caa-bfe9-36f668ab3b47 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.604575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 131/261] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:15.614005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.614441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.614542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.638664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:15.639801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:15.647561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 131/262] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:30:15.670346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafc9d-7882-4caa-bfe9-36f668ab3b47 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:15.684507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafc9d-7882-4caa-bfe9-36f668ab3b47 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:15.690264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:15.691036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.691326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.691609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.703374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:15.709959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:15.711075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 132/263] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:15.716708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:15.725997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b63f6-d872-439c-9c87-26b16b6b3213 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:15.731933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:15.732524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.732810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.733088 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.733808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:15.734148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:15.759396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:15.769129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 132/264] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:15.775435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:15.788313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6addaa7-cfa5-4c5d-b1e9-116ebce6e813 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:15.794257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:15.794862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.795152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.795431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.803655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:15.828975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:15.837947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 133/265] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:15.845826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:15.855968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bc3f6-4b1f-4f64-a7f3-51f78589606d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:15.862636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:15.865213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.865213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.865213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.865926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:15.891580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:15.893129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 133/266] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:15 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:15.899277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:15.911229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baf7c2-a37e-4a80-a37e-e5c9c551b87b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:15.917284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644a5a-171e-4b75-89bf-91e8298b748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:15.918067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644a5a-171e-4b75-89bf-91e8298b748c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.918357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644a5a-171e-4b75-89bf-91e8298b748c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.918663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644a5a-171e-4b75-89bf-91e8298b748c admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.919958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644a5a-171e-4b75-89bf-91e8298b748c admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:15.945829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644a5a-171e-4b75-89bf-91e8298b748c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:15.947333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 134/267] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:15 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:15.953083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:15.968255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb5c2d-cce2-49cf-ba97-0ef212b46d7c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:15.976950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:15.977861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:15.978264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:15.978615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:15.979818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:15.980242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:16.007567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992c411-34d0-46f7-a6cc-7ee13a50ffec admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:16.013429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 134/268] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:15 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 260 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:17.936484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf295b7-145d-48ee-88b3-516d3ebf0c49 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:17.937398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf295b7-145d-48ee-88b3-516d3ebf0c49 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:17.937398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf295b7-145d-48ee-88b3-516d3ebf0c49 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:17.940230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 135/269] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:17.948671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:17.949359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:17.949547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:17.983347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:17.984920 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:17.992587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 135/270] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:18.017361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf295b7-145d-48ee-88b3-516d3ebf0c49 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:18.032204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf295b7-145d-48ee-88b3-516d3ebf0c49 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:18.037461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:18.038183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:18.038463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:18.038776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:18.052529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:18.059037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:18.060104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 136/271] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:18.066381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:18.080196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892350f-7655-4e69-8160-40ed306f4a66 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:18.088491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:18.089411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:18.089859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:18.090287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:18.091482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:18.091950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:18.118450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:18.127276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 136/272] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:18.135683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:18.154615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1add41-8bbf-4b70-9ebc-55b0bc2fd859 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:18.160740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:18.161504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:18.161783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:18.162053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:18.163715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:18.189737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:18.191236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 137/273] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:18 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:18.196981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:18.207208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5b89-9da1-44b7-acba-ad3ced319ec7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:18.212793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feca3d-ecb2-43d2-957d-40fc67a40a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:18.213579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feca3d-ecb2-43d2-957d-40fc67a40a19 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:18.213861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feca3d-ecb2-43d2-957d-40fc67a40a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:18.214135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feca3d-ecb2-43d2-957d-40fc67a40a19 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:18.215473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feca3d-ecb2-43d2-957d-40fc67a40a19 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:18.241931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feca3d-ecb2-43d2-957d-40fc67a40a19 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:18.243446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 137/274] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:18 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:18.249718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:18.265043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850561-fb59-4e50-b950-f5bfe30b2c8f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:18.270648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100770a-2432-469b-a4f0-39b80d676421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:18.271456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100770a-2432-469b-a4f0-39b80d676421 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:18.271712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100770a-2432-469b-a4f0-39b80d676421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:18.271989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100770a-2432-469b-a4f0-39b80d676421 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:18.274364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100770a-2432-469b-a4f0-39b80d676421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3c0e728d554f76a7ce01429aa5c2d6, group_id=5bedff74ba7948b89e57a4b3a7b90955, role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:18.300349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100770a-2432-469b-a4f0-39b80d676421 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:18.317168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 138/275] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Feb 28 18:30:18 2022] PUT /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:20.301854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f840f-43e8-46af-a592-fde8ed180392 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.302792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f840f-43e8-46af-a592-fde8ed180392 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.302792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f840f-43e8-46af-a592-fde8ed180392 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.305448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 138/276] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:20.313414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.313838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.313941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.337891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:20.339072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:20.405995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 139/277] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:30:20.429562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f840f-43e8-46af-a592-fde8ed180392 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:20.449883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f840f-43e8-46af-a592-fde8ed180392 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:20.455671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:20.456397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.456678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.456954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.469959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:20.476809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:20.477922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 139/278] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:20.483967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:20.493165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416db803-954e-4bf5-b3fb-eb1c34f56569 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:20.498249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:20.498870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.499157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.499437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.500241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:20.500536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:20.525557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:20.534110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:20.540101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:20.552029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d851d-632c-49ad-a35c-8dc8a1df2bdb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:20.558037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:20.558600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.558911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.559184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.567364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:20.592732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:20.602268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 140/280] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:20 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:20.607860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:20.617947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315897e-66d7-4501-93c3-9de349612120 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:20.623038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:20.623815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.624110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.624388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.625634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:20.651147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:20.652638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 141/281] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:20 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:20.658787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:20.672637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee7621-35f2-49b4-8460-a043f064f016 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:20.678393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bc1d3-8bc7-4960-9319-9f976fc4b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:20.679253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bc1d3-8bc7-4960-9319-9f976fc4b0ad admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.679534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bc1d3-8bc7-4960-9319-9f976fc4b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.679803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bc1d3-8bc7-4960-9319-9f976fc4b0ad admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.681076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bc1d3-8bc7-4960-9319-9f976fc4b0ad admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:20.706654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bc1d3-8bc7-4960-9319-9f976fc4b0ad admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:20.708085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:20 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:20.717966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:20.733648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956619d-130d-4965-b443-18cf4b82d2fb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:20.739142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:20.739702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:20.739982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:20.740259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:20.741022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:20.741323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:20.766747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ec74c-7cfe-4fd4-b290-a72b589ead04 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:20.773177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:20 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 611 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:22.758543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cbcb2-a993-44d8-8b90-58b7f7b678fe None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:22.759473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cbcb2-a993-44d8-8b90-58b7f7b678fe None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:22.759473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cbcb2-a993-44d8-8b90-58b7f7b678fe None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:22.762193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 142/284] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:22.768180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:22.768593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:22.768717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:22.792139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:22.793255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:22.801721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 143/285] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:22.831143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cbcb2-a993-44d8-8b90-58b7f7b678fe None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:22.851847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cbcb2-a993-44d8-8b90-58b7f7b678fe None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:22.859773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:22.860473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:22.860752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:22.861018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:22.873483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:22.879912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:30:22.880994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 143/286] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:22.886807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:22.896801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413f58-5a32-43de-b8b2-14878dfb570a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:22.901199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:22.901787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:22.902067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:22.902346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:22.903098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:22.903389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:22.928756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:22.938099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:30:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:22.947066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:22.957672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65457f-0743-4cca-bb40-04aec3a487e4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:22.962647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:22.963195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:22.963470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:22.963749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:22.971445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:22.996588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:23.005458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:22 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:23.014345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:23.025045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd32a65-8c2a-4543-a8f8-2003f51092f5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:23.031096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:23.031875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:23.032158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:23.032470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:23.033752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:23.059390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:23.060883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:23 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:23.067016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:23.080543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537f2b-13cd-483d-9afc-0bdd0d99ad6a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:23.089056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19856-309a-4d94-a8ff-6f99cc4a22d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:23.090249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19856-309a-4d94-a8ff-6f99cc4a22d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:23.090762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19856-309a-4d94-a8ff-6f99cc4a22d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:23.091215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19856-309a-4d94-a8ff-6f99cc4a22d5 admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:23.093414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f19856-309a-4d94-a8ff-6f99cc4a22d5 admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:23.118756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f19856-309a-4d94-a8ff-6f99cc4a22d5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:23.120165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:23 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:23.125930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:23.136278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324181-54d3-41ea-bd93-8815900451cf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:23.142278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:23.142872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:23.143154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:23.143438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:23.144245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=135c7b26eb2e41df8d28464867dd66a8) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:23.144546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:23.169759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c79be-d422-4116-8c08-f985a6415017 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:23.175590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 146/291] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:23 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:25.106827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71dfdf-7e74-48d4-88a3-67673ae8cb2d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.107362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71dfdf-7e74-48d4-88a3-67673ae8cb2d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.107362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71dfdf-7e74-48d4-88a3-67673ae8cb2d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.109170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 146/292] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:25.115608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.116354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.116499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.149475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:25.150592 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:25.162493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 147/293] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:25.184998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71dfdf-7e74-48d4-88a3-67673ae8cb2d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:25.197710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71dfdf-7e74-48d4-88a3-67673ae8cb2d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:25.201921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:25.202914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.203475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.203751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.216222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:25.223288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:30:25.224402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 147/294] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:25.232919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:25.243185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b078400-2a11-4ceb-94e3-a4a25d4d834b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:25.248871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:25.249530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.249816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.250096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.250843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:25.251144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:25.276428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:25.285828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 148/295] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:30:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:25.294877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:25.312232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1cfef-253b-481d-bed3-f5e867b25c79 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:25.317874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:25.318679 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.318963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.319235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.320522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:25.345673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:25.347185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 148/296] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:25 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:25.353749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:25.370089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1593d-7433-491c-85a9-7fadbb4e6350 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:25.377285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eea62c-39ea-405a-b5fa-ffcdaab32b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:25.378075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eea62c-39ea-405a-b5fa-ffcdaab32b08 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.378358 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eea62c-39ea-405a-b5fa-ffcdaab32b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.378674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eea62c-39ea-405a-b5fa-ffcdaab32b08 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.379897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eea62c-39ea-405a-b5fa-ffcdaab32b08 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:25.405444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eea62c-39ea-405a-b5fa-ffcdaab32b08 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:25.407116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 149/297] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:25 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:25.413063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:25.429204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734949f9-8a6c-4abc-b703-c27df62b8102 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:25.436000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94acb4-2605-4b63-9e7d-160f3c67dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:25.436858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94acb4-2605-4b63-9e7d-160f3c67dbae admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:25.437168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94acb4-2605-4b63-9e7d-160f3c67dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:25.437168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94acb4-2605-4b63-9e7d-160f3c67dbae admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:25.439414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94acb4-2605-4b63-9e7d-160f3c67dbae admin admin] RBAC: Authorizing `identity:create_grant(project_id=135c7b26eb2e41df8d28464867dd66a8, group_id=5bedff74ba7948b89e57a4b3a7b90955, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:25.465300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94acb4-2605-4b63-9e7d-160f3c67dbae admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:25.486067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Feb 28 18:30:25 2022] PUT /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:27.457824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c30cde-7bd8-46f0-aa6b-71fa47b2ac1a None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.458371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c30cde-7bd8-46f0-aa6b-71fa47b2ac1a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.458371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c30cde-7bd8-46f0-aa6b-71fa47b2ac1a None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.460359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 150/299] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:27.466433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.467196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.467403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.497109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:27.498238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:27.564367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 150/300] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:27.599015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c30cde-7bd8-46f0-aa6b-71fa47b2ac1a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:27.612426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c30cde-7bd8-46f0-aa6b-71fa47b2ac1a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:27.617097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:27.617814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.618096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.618377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.631003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:27.637351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 18:30:27.638470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 151/301] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:27.646226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:27.655873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209a196-8fd7-4dd0-85ee-cc44f514303c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:27.660831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:27.661427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.661709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.661980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.662720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:27.663016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:27.688389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:27.702069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 151/302] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:27.711335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:27.724248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efe93a-4bb5-40f6-828e-4787bb0e9fa7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:27.729664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:27.730699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.731217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.731664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.740439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:27.767682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:27.777231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 152/303] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:27 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:27.783452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:27.793842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3595d41-0625-4736-9eff-311e03dab0f8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:27.799249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:27.800029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.800315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.800590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.801875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:27.828453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:27.829980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 152/304] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:27 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:27.837935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:27.849723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b037-ef17-4a1f-a358-b91b47f6b54d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:27.855842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1904d-00d3-45d4-a99f-67342cae13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:27.856625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1904d-00d3-45d4-a99f-67342cae13e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.856914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1904d-00d3-45d4-a99f-67342cae13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.857195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1904d-00d3-45d4-a99f-67342cae13e8 admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.858497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1904d-00d3-45d4-a99f-67342cae13e8 admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:27.884188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1904d-00d3-45d4-a99f-67342cae13e8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:27.885654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:27 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:27.892128 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:27.907257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e0b3-5d66-4c40-9004-cd6ceef80499 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:27.912372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:27.912946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:27.913228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:27.913507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:27.914286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=3038e8c9361243ec8eb72096cd6ca12b, scope.project.id=135c7b26eb2e41df8d28464867dd66a8) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:27.914587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:27.939901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496cd3-aa98-478c-94e3-d214088f7abf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:27.946349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:27 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=3038e8c9361243ec8eb72096cd6ca12b => generated 611 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:29.926280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5bd66-248d-4f6d-8cad-379ad6da70a0 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:29.926870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5bd66-248d-4f6d-8cad-379ad6da70a0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:29.926870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5bd66-248d-4f6d-8cad-379ad6da70a0 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:29.928569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 154/307] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:29.934803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:29.935509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:29.935647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:29.961373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:29.962495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:29.971055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 154/308] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:30.005402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5bd66-248d-4f6d-8cad-379ad6da70a0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:30.017985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5bd66-248d-4f6d-8cad-379ad6da70a0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:30.022437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:30.023192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:30.023493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:30.023774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:30.035636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:30.042307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:30.043419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 155/309] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:30.049607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:30.063266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516577-f46c-4a43-8c2d-f6f439338af7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:30.070312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:30.070960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:30.071247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:30.071522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:30.072241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:30.072535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:30.100493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:30.110666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:30.119440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:30.132570 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f728-7083-42e4-a456-693d3b1f4608 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:30.137885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:30.138466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:30.138781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:30.139065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:30.147955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:30.173466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:30.182140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 156/311] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:30.187766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:30.197488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9a1-d888-4232-ab33-1e902b737a43 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:30.202191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:30.203146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:30.203437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:30.203716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:30.204937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:30.230680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:30.232221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 156/312] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:30 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:30.238307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:30.252769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db555d-29d0-4471-b32c-d8b4b171dad3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:30.260806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc656-606a-445a-8568-30b353e6683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:30.261979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc656-606a-445a-8568-30b353e6683b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:30.262381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc656-606a-445a-8568-30b353e6683b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:30.262772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc656-606a-445a-8568-30b353e6683b admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:30.264593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bc656-606a-445a-8568-30b353e6683b admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:30.290600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bc656-606a-445a-8568-30b353e6683b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:30.292098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 157/313] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:30 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:30.299285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:30.309656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7378112-ddc3-4a80-8116-ea757978c3e5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:30.315537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:30.316103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:30.316388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:30.316664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:30.317435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=135c7b26eb2e41df8d28464867dd66a8) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:30.317738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:30.342902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0d15-9a02-4b7a-ac86-6c2566c97bf6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:30.348649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:30 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:32.332696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031c6e8-f351-40ff-955a-9c0684857f17 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.333261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031c6e8-f351-40ff-955a-9c0684857f17 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.333261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031c6e8-f351-40ff-955a-9c0684857f17 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.334938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 158/315] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:32.341066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.341716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.342011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.367134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:32.368277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:32.376835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:32.400052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031c6e8-f351-40ff-955a-9c0684857f17 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:32.423210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031c6e8-f351-40ff-955a-9c0684857f17 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:32.428033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:32.428779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.429060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.429344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.443015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:32.449610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:32.450750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:32.459864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:32.474115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68ad7c-b91a-4238-bfc3-1b0b5b00774e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:32.482341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:32.483227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.483699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.484281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.484907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:32.485211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:32.510439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:32.520246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 159/318] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:32.526205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:32.545415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655b8a0-13ac-4a8b-94e6-cfd9afaaf1f2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:32.551325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:32.552098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.552378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.552650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.553920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:32.580003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:32.581442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 160/319] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:32 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:32.590033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:32.606252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04f575-7866-4204-a2b0-9ae16a1426f6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:32.612571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d49d5-aefe-4990-a5fa-80e659e9c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:32.613355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d49d5-aefe-4990-a5fa-80e659e9c8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.613642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d49d5-aefe-4990-a5fa-80e659e9c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.613920 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d49d5-aefe-4990-a5fa-80e659e9c8f2 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.615193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d49d5-aefe-4990-a5fa-80e659e9c8f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:32.640864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d49d5-aefe-4990-a5fa-80e659e9c8f2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:32.642392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 160/320] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:32 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:32.648381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:32.664190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e44822-5ee5-40cc-9a4d-bd8ea94edde4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:32.672219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f79a5-382e-4aa3-81d0-ed1dfe3b3c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:32.673008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f79a5-382e-4aa3-81d0-ed1dfe3b3c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:32.673288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f79a5-382e-4aa3-81d0-ed1dfe3b3c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:32.673568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f79a5-382e-4aa3-81d0-ed1dfe3b3c79 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:32.675918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f79a5-382e-4aa3-81d0-ed1dfe3b3c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135c7b26eb2e41df8d28464867dd66a8, group_id=5bedff74ba7948b89e57a4b3a7b90955, role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:32.701743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f79a5-382e-4aa3-81d0-ed1dfe3b3c79 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:32.723029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 161/321] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Feb 28 18:30:32 2022] PUT /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8/groups/5bedff74ba7948b89e57a4b3a7b90955/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:34.649879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf106c7-95e0-49fc-9167-588dd99b9b08 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:34.650838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf106c7-95e0-49fc-9167-588dd99b9b08 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:34.650838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf106c7-95e0-49fc-9167-588dd99b9b08 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:34.653593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 161/322] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:34.659038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:34.659475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:34.659568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:34.682600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:34.683740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:34.759760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 162/323] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:34.784602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf106c7-95e0-49fc-9167-588dd99b9b08 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:34.797128 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf106c7-95e0-49fc-9167-588dd99b9b08 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:34.801402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:34.802141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:34.802436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:34.802750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:34.815529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:34.822200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:30:34.823396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 162/324] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:30:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:34.829230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:34.838447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b30c2-d20c-4889-8fa8-22fd2532d8fa None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:34.843991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:34.844640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:34.844931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:34.845217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:34.845940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:34.846275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:34.872244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:34.881613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 163/325] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:34.887931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:34.899208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebffb8-f470-4234-a690-d1be98a5e6d1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:34.905065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:34.905824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:34.906037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:34.906308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:34.914881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:34.940898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:34.949198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 163/326] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:34 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:34.957803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:34.973285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a5762-cd3d-4cd7-8d94-70717b77519d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:34.981829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:34.983352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:34.983919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:34.984231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:34.987927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:35.013705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:35.015335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:34 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:35.021423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:35.033725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab2e36-ad6d-401c-aeef-6d06e407e648 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:35.039159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fd50-3cc2-4e2f-8c5c-4ca145635140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:35.039925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fd50-3cc2-4e2f-8c5c-4ca145635140 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:35.040204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fd50-3cc2-4e2f-8c5c-4ca145635140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:35.040468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fd50-3cc2-4e2f-8c5c-4ca145635140 admin admin] PATH_INFO: `/v3/groups/5bedff74ba7948b89e57a4b3a7b90955` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:35.041662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470fd50-3cc2-4e2f-8c5c-4ca145635140 admin admin] RBAC: Authorizing `identity:get_group(group_id=5bedff74ba7948b89e57a4b3a7b90955)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:35.067510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470fd50-3cc2-4e2f-8c5c-4ca145635140 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:35.068933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 164/328] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:35 2022] GET /identity/v3/groups/5bedff74ba7948b89e57a4b3a7b90955 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:35.077544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:35.092862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63986be-fe51-4c66-8e28-f560c0e59e95 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:35.099845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:35.100662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:35.101089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:35.101446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:35.102650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] RBAC: Adding query filter params (group.id=5bedff74ba7948b89e57a4b3a7b90955, role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=135c7b26eb2e41df8d28464867dd66a8) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:35.103036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:35.136633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae14f-3dfc-43af-ab91-110e63ae0889 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:35.142821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:35 2022] GET /identity/v3/role_assignments?group.id=5bedff74ba7948b89e57a4b3a7b90955&scope.project.id=135c7b26eb2e41df8d28464867dd66a8&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 611 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:37.111966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3692b89-bf5b-42a0-862d-8bc3c995abee None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.112547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3692b89-bf5b-42a0-862d-8bc3c995abee None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.112547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3692b89-bf5b-42a0-862d-8bc3c995abee None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.114205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 165/330] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:37.120505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.121174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.121447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.152723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:37.153860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:37.162373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 166/331] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:37.184976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3692b89-bf5b-42a0-862d-8bc3c995abee None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:37.198584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3692b89-bf5b-42a0-862d-8bc3c995abee None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:37.203460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:37.204177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.204467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.204744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.217335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:37.223960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:30:37.225067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:37.231463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:37.241355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4966d-819f-4c11-83a7-f9323cd36827 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:37.246499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:37.247125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.247406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.247679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.248388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:37.248683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:37.273854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:37.283314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 167/333] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:37.291962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:37.308884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d6bbe-3bed-4ebc-b378-1d42e85eb6d7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:37.315823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:37.316387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.316675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.316952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.325215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:37.350844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:37.359978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 167/334] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:37 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:37.366241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:37.379570 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa8c66-6384-4d50-b7d4-a566e47bfb60 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:37.385446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:37.386249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.386532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.386843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] PATH_INFO: `/v3/projects/59acec3e713d40f0a23abdd9569d7387` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.388141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] RBAC: Authorizing `identity:get_project(project_id=59acec3e713d40f0a23abdd9569d7387)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:37.413618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:37.415139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 168/335] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:37 2022] GET /identity/v3/projects/59acec3e713d40f0a23abdd9569d7387 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:37.423424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:37.437004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb258b0-f721-49a1-8f43-78b2cd4139c4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:37.442904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151d830-465e-483d-a745-28433490ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:37.443682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151d830-465e-483d-a745-28433490ebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.443968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151d830-465e-483d-a745-28433490ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.444242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151d830-465e-483d-a745-28433490ebb6 admin admin] PATH_INFO: `/v3/groups/58ad6f302f7940feb2ddfe9641027550` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.449695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151d830-465e-483d-a745-28433490ebb6 admin admin] RBAC: Authorizing `identity:get_group(group_id=58ad6f302f7940feb2ddfe9641027550)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:37.475460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151d830-465e-483d-a745-28433490ebb6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:37.476916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 168/336] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:37 2022] GET /identity/v3/groups/58ad6f302f7940feb2ddfe9641027550 => generated 229 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:37.483013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:37.498361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1cd15-c8f0-455c-871a-b5396f6ede56 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:37.504146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:37.504726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:37.505007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:37.505281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:37.506062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] RBAC: Adding query filter params (group.id=58ad6f302f7940feb2ddfe9641027550, role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=59acec3e713d40f0a23abdd9569d7387) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:37.506365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:37.531827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca5d0e-142b-4e68-80ea-0311b46223bc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:37.537662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 169/337] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:37 2022] GET /identity/v3/role_assignments?group.id=58ad6f302f7940feb2ddfe9641027550&scope.project.id=59acec3e713d40f0a23abdd9569d7387&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:39.490824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e4ad0-051d-40e4-9db3-cb9cfd7895dc None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.491322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e4ad0-051d-40e4-9db3-cb9cfd7895dc None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.491322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e4ad0-051d-40e4-9db3-cb9cfd7895dc None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.493835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 169/338] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:39.502614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.502994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.503232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.530470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:39.531753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:39.538884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 170/339] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:39.562232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e4ad0-051d-40e4-9db3-cb9cfd7895dc None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:39.586081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e4ad0-051d-40e4-9db3-cb9cfd7895dc None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:39.594146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:39.594978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.595265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.595588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.607901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:39.614972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:30:39.616167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:39.622994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:39.636737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d48c4-3e8c-49a1-935c-c569469ad529 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:39.645040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:39.645932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.646324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.646755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.647927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:39.648328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:39.676694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:39.686121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 171/341] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:30:39.695103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:39.712073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899945e-d092-44e4-b8e1-c3ba4cbd2ba4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:39.719237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:39.719991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.720271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.720541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] PATH_INFO: `/v3/groups/58ad6f302f7940feb2ddfe9641027550` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.721685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] RBAC: Authorizing `identity:get_group(group_id=58ad6f302f7940feb2ddfe9641027550)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:39.747075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:39.748469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:39 2022] GET /identity/v3/groups/58ad6f302f7940feb2ddfe9641027550 => generated 229 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:39.754851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:39.770812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62ddc4-bd02-4717-a7fc-4769b86d2e07 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:39.777325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f76594-2233-4177-acfe-0e863d389507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:39.778112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f76594-2233-4177-acfe-0e863d389507 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.778394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f76594-2233-4177-acfe-0e863d389507 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.778704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f76594-2233-4177-acfe-0e863d389507 admin admin] PATH_INFO: `/v3/projects/59acec3e713d40f0a23abdd9569d7387` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.779927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f76594-2233-4177-acfe-0e863d389507 admin admin] RBAC: Authorizing `identity:get_project(project_id=59acec3e713d40f0a23abdd9569d7387)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:39.805968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f76594-2233-4177-acfe-0e863d389507 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:39.807571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 172/343] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:39 2022] GET /identity/v3/projects/59acec3e713d40f0a23abdd9569d7387 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:39.813672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:39.824803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3475f-02ca-445a-8e23-a675a1fb8cc3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:39.830419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20366de-75cf-4d8e-af94-dccb21e4edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:39.831333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20366de-75cf-4d8e-af94-dccb21e4edf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:39.831647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20366de-75cf-4d8e-af94-dccb21e4edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:39.831985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20366de-75cf-4d8e-af94-dccb21e4edf8 admin admin] PATH_INFO: `/v3/projects/59acec3e713d40f0a23abdd9569d7387/groups/58ad6f302f7940feb2ddfe9641027550/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:39.834324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20366de-75cf-4d8e-af94-dccb21e4edf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59acec3e713d40f0a23abdd9569d7387, group_id=58ad6f302f7940feb2ddfe9641027550, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:39.863188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20366de-75cf-4d8e-af94-dccb21e4edf8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:39.886103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 172/344] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Feb 28 18:30:39 2022] PUT /identity/v3/projects/59acec3e713d40f0a23abdd9569d7387/groups/58ad6f302f7940feb2ddfe9641027550/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:41.832890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f45146-8d1c-42ad-bba8-f5f5e84beed2 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:41.833442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f45146-8d1c-42ad-bba8-f5f5e84beed2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:41.833442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f45146-8d1c-42ad-bba8-f5f5e84beed2 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:41.835160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 173/345] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:41.841243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:41.841679 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:41.841772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:41.868746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:41.869893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:41.940473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 173/346] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:41.974297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f45146-8d1c-42ad-bba8-f5f5e84beed2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:41.989112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f45146-8d1c-42ad-bba8-f5f5e84beed2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:41.994830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:41.995546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:41.995834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:41.996114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:42.008646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:42.015082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:30:42.016176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 174/347] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:42.022690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:42.035183 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc10c-15db-48e9-bd64-45b54761ee30 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:42.040968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:42.041562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:42.041849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:42.042128 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:42.042886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:42.043189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:42.068515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:42.077748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 174/348] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:42.083522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:42.094391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec653-6208-48e2-bc43-2ff554499434 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:42.100586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:42.101167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:42.101457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:42.101722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:42.110212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:42.135593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:42.144547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 175/349] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:42.152757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:42.163074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410ef7c-fe47-423b-a9e5-276121b0c7dd admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:42.168165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:42.168948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:42.169234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:42.169514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] PATH_INFO: `/v3/projects/59acec3e713d40f0a23abdd9569d7387` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:42.170746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=59acec3e713d40f0a23abdd9569d7387)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:42.196130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:42.197702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 175/350] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:30:42 2022] GET /identity/v3/projects/59acec3e713d40f0a23abdd9569d7387 => generated 344 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:30:42.203419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:42.214239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36e79-d2aa-4ce6-b1ad-6605e8b49a60 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:42.222306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d6e2-ce06-441a-ab32-e4d98c4455ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:42.223757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d6e2-ce06-441a-ab32-e4d98c4455ec admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:42.224195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d6e2-ce06-441a-ab32-e4d98c4455ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:42.224582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d6e2-ce06-441a-ab32-e4d98c4455ec admin admin] PATH_INFO: `/v3/groups/58ad6f302f7940feb2ddfe9641027550` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:42.226414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0d6e2-ce06-441a-ab32-e4d98c4455ec admin admin] RBAC: Authorizing `identity:get_group(group_id=58ad6f302f7940feb2ddfe9641027550)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:42.255031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0d6e2-ce06-441a-ab32-e4d98c4455ec admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:42.256518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 176/351] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Feb 28 18:30:42 2022] GET /identity/v3/groups/58ad6f302f7940feb2ddfe9641027550 => generated 229 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:42.262811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:42.273332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f8baa-f6a7-4214-88b7-164c0cbbe8d5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:42.279239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:42.279850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:42.280133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:42.280409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:42.281465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] RBAC: Adding query filter params (group.id=58ad6f302f7940feb2ddfe9641027550, role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=59acec3e713d40f0a23abdd9569d7387) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:42.281811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:42.309584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175d4bf-8435-44a6-8231-11c09a45ae55 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:42.316312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 176/352] 10.222.0.18 () {56 vars in 1397 bytes} [Mon Feb 28 18:30:42 2022] GET /identity/v3/role_assignments?group.id=58ad6f302f7940feb2ddfe9641027550&scope.project.id=59acec3e713d40f0a23abdd9569d7387&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 611 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:44.324170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21e9c-18f6-4109-99b9-417d58840af4 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:44.324981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21e9c-18f6-4109-99b9-417d58840af4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:44.325251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21e9c-18f6-4109-99b9-417d58840af4 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:44.327999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 177/353] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:44.334129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:44.334908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:44.335447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:44.362593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:44.363761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:44.372839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 177/354] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:44.395889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb21e9c-18f6-4109-99b9-417d58840af4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:44.408914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb21e9c-18f6-4109-99b9-417d58840af4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:44.413271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:44.413979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:44.414264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:44.414541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:44.428200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:44.464305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:44.483101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:44.484181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 178/355] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:44.494102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:44.508559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32936-f4a8-4f54-9234-509d797c1f70 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:44.516974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:44.517565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:44.517849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:44.518127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:44.518843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:44.519136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:44.544112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc647-09fb-4fd9-abbd-e681afc72e93 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:44.558051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 178/356] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:44.567214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:44.583327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b036e41-8243-46ff-aa22-22c607e2525a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:44.588512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:44.589099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:44.589383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:44.589655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:44.590295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:44.615456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:44.615456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:30:44.615456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:30:44.616650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f72117-bdd0-47f9-acbd-36b6408d766e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:44.649782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 179/357] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:30:44 2022] POST /identity/v3/users => generated 246 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:30:46.635770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d05963-d4b8-4776-8430-6a9e53d1c982 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:46.636652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d05963-d4b8-4776-8430-6a9e53d1c982 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:46.636652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d05963-d4b8-4776-8430-6a9e53d1c982 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:46.639404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 179/358] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:46.645501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:46.645937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:46.646079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:46.682087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:46.683259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:46.691432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 180/359] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:46.714886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d05963-d4b8-4776-8430-6a9e53d1c982 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:46.735239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d05963-d4b8-4776-8430-6a9e53d1c982 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:46.740344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:46.741063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:46.741345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:46.741605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:46.753293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:46.759687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:30:46.760775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 180/360] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:30:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:46.766701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:46.776271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47cd19-25d9-4eb8-ab90-1d1052966d20 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:46.782178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:46.782797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:46.783081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:46.783339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:46.784051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:46.784346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:46.809599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:46.818491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 181/361] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:30:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:46.824383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:46.836397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f4995-f824-4f6d-a56b-5452258fa9a3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:46.842164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:46.842901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:46.843183 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:46.843457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:46.855690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:46.880981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:46.899674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:46.900661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 181/362] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:46.910263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:46.930074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a4e0b-3eda-4e9b-a752-72e6f74aa2c7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:46.935154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:46.935741 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:46.936023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:46.936296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:46.936989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:46.937321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:46.962695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:46.962695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:30:46.962695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:30:46.963557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:46.978389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 182/363] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:46.984759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.000074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128c5d9-bc80-46e7-8df0-bf9e225a52d9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.006275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.007018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.007306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.007578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.021558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.047001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.065125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:30:47.066207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 182/364] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:30:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:47.075346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.091740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7127-0e2a-418d-9da9-2680ca2f95a4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.098967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.099554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.099834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.100113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.100905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:47.101202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.128016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:47.128016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:30:47.128016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:30:47.129162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.159682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 183/365] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:47.165254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.175266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528c86-361e-46fc-a6e5-c4871f312340 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.179995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.180571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.180860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.181138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.189862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.215262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.225685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 183/366] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:47.231543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.243382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f4e0-18d0-435b-b499-74e80d56b973 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.250830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.251807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.252090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.252366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.264752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.290759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.308534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:47.309645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 184/367] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:30:47.315522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.325575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9280-34aa-4e52-bea9-290155627ec7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.330628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.331215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.331490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.331764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.332452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:47.332749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.358902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.372671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 184/368] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:47.378249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.387555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80c10b-8ba7-4d82-b462-8915b1e67a3f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.391964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.392767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.393050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.393322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.402177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.427692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.441951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:30:47.443024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 185/369] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:47.448535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.458509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b48f0-08a3-41c0-b288-5a3bcca61772 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.465115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.466045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.466516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.467024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.468249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:47.468741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.501470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:47.501470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:30:47.501470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:30:47.502595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4f9ad-0ae4-40eb-ad35-7551aa0999cb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.515987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 185/370] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:30:47.525015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:47.540982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ee2ca-3b89-4881-bf8e-a6ad586f6f91 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:47.547861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:47.548431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:47.548715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:47.548988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:47.549921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=2df0c8ccfb9944d4a8d0ccb4745bc714) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:47.550273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:47.578970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d288e-7b40-4769-9938-dd022f947dd7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:47.585391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 186/371] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:30:47 2022] GET /identity/v3/role_assignments?user.id=2df0c8ccfb9944d4a8d0ccb4745bc714&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:49.514660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246648-d419-45ea-b068-31af34895d53 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.515191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246648-d419-45ea-b068-31af34895d53 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.515191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246648-d419-45ea-b068-31af34895d53 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.516925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 186/372] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:49.523225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.524054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.524172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.550915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:49.552042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:49.561166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 187/373] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:49.583696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246648-d419-45ea-b068-31af34895d53 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:49.602303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246648-d419-45ea-b068-31af34895d53 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:49.608025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:49.608749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.609034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.609310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.621227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:49.627691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:30:49.628769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 187/374] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:30:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:49.637431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:49.648406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfdeee-50ef-41db-83ab-4bc3abaa40e0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:49.654298 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:49.654916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.655192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.655464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.656180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:49.656471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:49.682424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:49.691977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 188/375] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:49.698230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:49.710776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa2415-45df-4317-8922-d1d5d316e61e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:49.716715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:49.717424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.717710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.717987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.730452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:49.755835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:49.775641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:49.776646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 188/376] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:49.785455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:49.802480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222198-f7c2-43ff-b29a-ff9c1e961695 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:49.808395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:49.808990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.809275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.809551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.810246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:49.810546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:49.835780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:49.854130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 189/377] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:49.862940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:49.879236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10062b-7ad9-4fb5-b185-380ea5fd81fd admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:49.887103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:49.888134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.888479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.888832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.905952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:49.931921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:49.950601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:30:49.951656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 189/378] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:30:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:49.960511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:49.974412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03525d1-caad-46f7-8901-e6d7b05984f7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:49.979676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:49.980268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:49.980549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:49.980824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:49.981613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:49.981916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:50.007521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:50.116618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 190/379] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:30:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:50.122943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:50.135225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6aea-3385-499b-b16c-d1fb9c2c3331 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:50.140265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:50.140975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:50.141450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:50.142017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:50.240566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:50.265683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:50.284245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:50.285357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 190/380] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:50.294549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:50.310899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4e498-7d0d-44e3-9c52-ce38e5381325 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:50.317429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:50.318024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:50.318312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:50.318584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:50.319302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:50.319602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:50.344985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:50.358920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 191/381] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:50.365259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:50.381030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615139ec-8575-440c-97b1-e846d1e93088 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:50.388360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:50.389448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:50.389825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:50.390197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:50.399807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:50.425541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:50.439996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:30:50.441049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 191/382] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:50.449860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:50.461753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad0c4-c129-4bc1-8918-01903df1128a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:50.466973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:50.467561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:50.467856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:50.468138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:50.468895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:50.469213 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:50.494183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:50.494183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:30:50.494183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:30:50.495314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb77d7-3462-433a-98f0-051e7d001351 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:50.508573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:50.514845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:50.530397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ba89-88b1-4ab9-bb05-df493b476e3b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:50.537759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c489b5e-bcd5-4b31-b6d2-e1b271eb2d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:50.539013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c489b5e-bcd5-4b31-b6d2-e1b271eb2d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:50.539385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c489b5e-bcd5-4b31-b6d2-e1b271eb2d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:50.539744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c489b5e-bcd5-4b31-b6d2-e1b271eb2d9e admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/2df0c8ccfb9944d4a8d0ccb4745bc714/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:50.564732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c489b5e-bcd5-4b31-b6d2-e1b271eb2d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=2df0c8ccfb9944d4a8d0ccb4745bc714, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:50.590818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c489b5e-bcd5-4b31-b6d2-e1b271eb2d9e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:50.608405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 192/384] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:30:50 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/2df0c8ccfb9944d4a8d0ccb4745bc714/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:30:52.570111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0eb2-b8ef-41c1-97c2-6f012c815af0 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.570691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0eb2-b8ef-41c1-97c2-6f012c815af0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.570691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0eb2-b8ef-41c1-97c2-6f012c815af0 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:52.572392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 193/385] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:52.578539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.579212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.579586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:52.608450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:52.609591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:52.676170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 193/386] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:52.698702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0eb2-b8ef-41c1-97c2-6f012c815af0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:52.713507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0eb2-b8ef-41c1-97c2-6f012c815af0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:52.718594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:52.719488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.719774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.720057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:52.734269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:52.740725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:30:52.741865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 194/387] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:30:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:52.747881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:52.758869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce778d-4e97-4f2e-af2f-d4f36b819e76 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:52.766138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:52.766832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.767091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.767364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:52.768080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:52.768418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:52.793630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:52.803035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 194/388] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:30:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:52.811054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:52.826398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1bf2-e609-4d04-9e87-0d04114573a9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:52.832530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:52.833243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.833534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.833810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:52.846528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:52.872161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:52.890477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:52.891625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 195/389] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:52.897957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:52.911884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb93b-96ec-4983-939d-65d914747523 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:52.918816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:52.919668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.920066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.920484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:52.921460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:52.921885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:52.947398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:52.960655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 195/390] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:52.969037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:52.980369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0c46-1435-4b08-a486-fa207a97a677 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:52.986331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:52.987193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:52.987469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:52.987761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.002357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.032661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.056256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:30:53.057350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 196/391] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:30:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:53.064046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.078236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1410ba-5c64-48c3-9e16-5c5060d9e275 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.085779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.086799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.087263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.087725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.088796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:53.089199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.115567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:30:53.115567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:30:53.115567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:30:53.116710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.150333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 196/392] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:53.159163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.169518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128248-c7c0-48c6-854e-898686064e89 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.175293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.175861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.176121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.176421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.185309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.211506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.221125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 197/393] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:53.227823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.242991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea375913-3e99-43cf-9ae8-ef217d12a92a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.250968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.251685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.251969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.252244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.264427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.289743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.307312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:53.308402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 197/394] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:53.317335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.333865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013577-77d5-4110-833a-2c8efb49ba04 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.342177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.343301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.343832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.344415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.345115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:53.345504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.375408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.391512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 198/395] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:53.397883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.411914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147590c-79b6-4b9e-80a1-aeb54beef3a9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.419411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.420435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.420895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.421360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.433690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.459124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.473777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:30:53.474903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 198/396] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:53.484066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.494345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2476-032c-4db8-9437-d6b70570f7ce admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.500277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.500863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.501152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.501431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.502180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:53.502479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.528102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c409-5074-4bb4-8263-1c2a0d062e4a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.542912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 199/397] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:53.549584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:53.565445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19094d1f-76f5-4168-bf83-a2ea6d3e6fa8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:53.573449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:53.574353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:53.574855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:53.575326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:53.576584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=2df0c8ccfb9944d4a8d0ccb4745bc714) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:53.577086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:53.603735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f001b-e54e-4688-a266-5199541b6f07 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:53.610283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 199/398] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:30:53 2022] GET /identity/v3/role_assignments?user.id=2df0c8ccfb9944d4a8d0ccb4745bc714&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:30:55.629111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9827ae1-7924-4905-9d90-58c988651cac None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.629659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9827ae1-7924-4905-9d90-58c988651cac None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.629659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9827ae1-7924-4905-9d90-58c988651cac None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:55.631400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 200/399] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:30:55.637592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.638265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.638512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:55.663058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:55.664181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:55.671855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 200/400] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:55.694149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9827ae1-7924-4905-9d90-58c988651cac None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:55.708968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9827ae1-7924-4905-9d90-58c988651cac None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:55.716256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:55.716975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.717254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.717530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:55.730936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:55.737195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:30:55.738284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 201/401] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:55.744902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:55.758825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd2dd0-be2c-4a97-bf61-793b6637c21f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:55.767010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:55.767608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.767888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.768164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:55.768879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:55.769172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:55.794117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:55.803473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 201/402] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:55.812450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:55.828657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8670-0f45-45d4-bfb2-aa6acee4ad2c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:55.834687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:55.835396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.835681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.835952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:55.848096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:55.876900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:55.896221 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:55.897256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 202/403] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:55.903830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:55.919141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5bf8f-4aef-40e0-86a4-125bb69ac48f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:55.926105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:55.926716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.927001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.927272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:55.927962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:55.928256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:55.953122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:55.967058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 202/404] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:55.973862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:55.983609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066ce9-6463-46b1-86ef-523e620bb1f5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:55.989474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:55.990173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:55.990457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:55.990761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.004083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.029646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.047684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:30:56.048598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 203/405] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:30:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:56.055088 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.067798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d228e-7ad6-4439-a91d-2efcad3b6232 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.073746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.074328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.074620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.074917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.075702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:56.075997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.101620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.132285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 203/406] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:56.138308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.148945 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57c77f-0d42-4bc6-87f4-116b5e2dc6d6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.157370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.157944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.158227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.158503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.166331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.193332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.201951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 204/407] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:30:56.208186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.220802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0d11f-2974-4908-9840-5ae6d38c4752 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.226999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.227714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.228001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.228274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.240547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.265699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.282896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:56.283986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 204/408] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:56.289582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.299003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb341f-cf04-40d0-a224-585795231d4e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.304846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.305438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.305718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.305991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.306704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:56.306998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.332981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.346671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 205/409] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:56.355466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.367005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a02588-af3e-4c28-a890-68180ca4557d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.372185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.372909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.373191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.373465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.382833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.408198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.422697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:30:56.423759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 205/410] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:56.430209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.446061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45961-d70a-4dfd-a8fb-3ef2177ab706 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.454454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.455069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.455354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.455631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.456371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:56.456669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.482294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9f8d-0764-4834-93f5-49b63765ebba admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.498251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 206/411] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:56.507257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:56.520151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd47ea-df80-4453-b20a-a3834a49cf6c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:56.524792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:56.525371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:56.525657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:56.525934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:56.526755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=2df0c8ccfb9944d4a8d0ccb4745bc714) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:56.527079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:56.552613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4673e-968b-45dc-a48a-4259bec9a80c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:56.558425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 206/412] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:30:56 2022] GET /identity/v3/role_assignments?user.id=2df0c8ccfb9944d4a8d0ccb4745bc714&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:58.493793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f224b-4f21-47f6-8380-62ea57c80256 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.494308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f224b-4f21-47f6-8380-62ea57c80256 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.494308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f224b-4f21-47f6-8380-62ea57c80256 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.496014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 207/413] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:30:58.502245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.503005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.503150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.528767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:30:58.529917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:30:58.541205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:30:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:30:58.562471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f224b-4f21-47f6-8380-62ea57c80256 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:58.574773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f224b-4f21-47f6-8380-62ea57c80256 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:58.579309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:58.580016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.580303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.580578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.593368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:30:58.600096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:30:58.601166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 208/415] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:30:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:58.607452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:58.621669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d5dc-2bec-407c-a677-e89787e750bf None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:58.628901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:58.629486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.629766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.630046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.630794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:58.631093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:58.656193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:58.665593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 208/416] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:30:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:58.674317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:58.689409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583c6b-b5d4-4266-9af2-ba5023db7000 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:58.695350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:58.696073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.696359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.696637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.709502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:58.735307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:58.753523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:58.754609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 209/417] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:58.761147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:58.776501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a717ce-8873-4d38-8a93-06ef6b18a07d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:58.783943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:58.784530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.784811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.785087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.785773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:58.786064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:58.811330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:58.825832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 209/418] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:58.834891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:58.848958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e800-368a-4ef4-b1b8-45d70a9e652e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:58.855025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:58.855736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.856022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.856301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.870089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:58.895830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:58.913484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:30:58.914543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 210/419] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:30:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:58.920877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:58.936022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906baaea-873b-4fc4-b0f3-ad0f73ad07f0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:58.942456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:58.943085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:58.943357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:58.943632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:58.944429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:58.944733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:58.970001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:59.000150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 210/420] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:30:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:59.006428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:59.019710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d9d80-fd40-4229-97e0-99c1a92a26d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:59.025023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:59.025746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:59.026021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:59.026293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:59.039174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:59.064734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:59.085424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:30:59.086512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 211/421] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:59.092745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:59.108730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9baed-080d-472b-9b37-9bd880aedba2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:59.114981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:59.115565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:59.115849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:59.116124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:59.116809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:59.117105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:59.142126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:59.154680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 211/422] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:59.163354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:59.175910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5c15a-23ec-4f0c-bf5b-fc181e76e35d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:59.180512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:59.181211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:59.181495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:59.181771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:59.190833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:59.215952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:59.230698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:30:59.231759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 212/423] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:30:59.238238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:59.254152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f72340-6213-4fb4-8379-1b81e890ff08 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:59.261342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:59.262178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:59.262723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:59.263198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:59.264410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:30:59.264909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:59.291058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb12c0-c8fd-47cc-84db-95af8b2812e2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:59.305298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:30:59.314742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:30:59.329199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce343-d293-4bb4-801c-bc94a0ee256f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:30:59.334532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698453-a3b2-4bf7-b533-ea69f6630daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:30:59.335431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698453-a3b2-4bf7-b533-ea69f6630daa admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:30:59.335715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698453-a3b2-4bf7-b533-ea69f6630daa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:30:59.335988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698453-a3b2-4bf7-b533-ea69f6630daa admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/2df0c8ccfb9944d4a8d0ccb4745bc714/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:30:59.338172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698453-a3b2-4bf7-b533-ea69f6630daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=2df0c8ccfb9944d4a8d0ccb4745bc714, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:30:59.364693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698453-a3b2-4bf7-b533-ea69f6630daa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:30:59.383349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 213/425] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:30:59 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/2df0c8ccfb9944d4a8d0ccb4745bc714/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:31:01.342116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7a3c-6217-418d-b376-71d986e6ed2c None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.342986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7a3c-6217-418d-b376-71d986e6ed2c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.343126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7a3c-6217-418d-b376-71d986e6ed2c None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.345954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 213/426] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:01.354933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.355642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.355845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.380820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:01.381975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:01.448196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 214/427] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:01.473068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7a3c-6217-418d-b376-71d986e6ed2c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.486997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7a3c-6217-418d-b376-71d986e6ed2c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.491922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.492637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.492922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.493200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.505406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:01.511639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:31:01.512711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 214/428] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:01.519683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.528345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e077c7-a1ad-4996-a51c-3ebe3824f4d5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.534225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.534843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.535121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.535396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.536108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:01.536404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:01.561993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:01.571303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 215/429] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:01.577256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.590200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62753f-15cb-442b-97cf-42d778bc6b0c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.595394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.596092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.596376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.596960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.609653 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:01.634647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:01.653043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:01.654090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 215/430] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:01.660448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.676171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e9294-f662-4818-bcb6-b499524f4086 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.683990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.684867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.685225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.685632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.686738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:01.687191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:01.713424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:01.727611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 216/431] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:01.733584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.749138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721c09e-9c64-4a2a-af7d-0ae80e0d99a8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.754490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.755231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.755512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.755786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.769780 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:01.795482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:01.813687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:31:01.814779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 216/432] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:01.823667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.839987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268ce6-6b50-45d0-998b-4a305ebae7ed admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.847371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.847964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.848253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.848526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.849326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:01.849626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:01.875964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:01.911022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 217/433] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:01.917010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.927250 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76a92-12e2-4da5-88ec-c933a731fcf4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:01.932978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:01.933545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:01.933820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:01.934096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:01.942862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:01.968051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:01.977374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 217/434] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:01.985927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:01.995946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e595c94-057b-4846-a1ad-a78df1599ad7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:02.001388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:02.002101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:02.002391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:02.002711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:02.017020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:02.042192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:02.059662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:02.060717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:02.069275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:02.078224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe8ef7-12d7-4a97-8611-29ea6254051b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:02.083084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:02.083655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:02.083930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:02.084203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:02.084880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:02.085172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:02.111240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:02.125115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 218/436] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:02.133986 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:02.146953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c469e-d780-4e0e-a32b-410fa1c77827 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:02.152814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:02.153519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:02.153804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:02.154079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:02.164287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:02.189647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:02.203996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:02.205092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 219/437] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:02.210783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:02.220955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f250f-47d8-4fb2-863f-37be268bcf5d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:02.226435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:02.227078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:02.227364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:02.227646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:02.228400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:02.228712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:02.254126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf553a6f-1dad-471b-b06c-2686eca8590f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:02.268345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 219/438] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:02.274837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:02.290629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b450-d6c7-4c47-9871-dc5783cfa823 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:02.298202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:02.298813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:02.299101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:02.299380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:02.300164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=2df0c8ccfb9944d4a8d0ccb4745bc714) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:02.300466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:02.326030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a3bf-9eef-4775-b099-cbbcb8f3093b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:02.332490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 220/439] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:02 2022] GET /identity/v3/role_assignments?user.id=2df0c8ccfb9944d4a8d0ccb4745bc714&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:04.311025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787066-a34a-41d7-ade8-52fded3e8f1c None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:04.311604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787066-a34a-41d7-ade8-52fded3e8f1c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:04.311604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4787066-a34a-41d7-ade8-52fded3e8f1c None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:04.313326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 220/440] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:04.319695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:04.320411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:04.320555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:04.348208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:04.349340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:04.360451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 221/441] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:04.382218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4787066-a34a-41d7-ade8-52fded3e8f1c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:04.395997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4787066-a34a-41d7-ade8-52fded3e8f1c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:04.400972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:04.401689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:04.401974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:04.402256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:04.402910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:04.427521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:04.427521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:31:04.427521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:31:04.428381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:04.440251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 18:31:04.441321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1153 bytes} [Mon Feb 28 18:31:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:04.447670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:04.458882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48a34a-c2b1-457e-b0cf-ee8c880db77c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:04.464554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:04.465136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:04.465419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:04.465691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:04.466360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:04.466681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:04.492028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:04.492028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:31:04.492028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:31:04.492880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993a0ce-a6f5-463a-abac-9a54066160cf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:04.497658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 222/443] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:31:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:04.504121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:04.518321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831ec28-c237-42c3-880f-4ae0820ce078 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:04.523820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:04.524408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:04.524692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:04.524968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:04.525638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:04.525934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:04.550575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:04.550575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:31:04.550575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:31:04.551460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92543f1-4c68-4f01-a64f-8aa6c4ac79ca admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:04.556492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:31:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:06.499200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262455-ec8b-4de9-83e4-107b3631ac47 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:06.499701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262455-ec8b-4de9-83e4-107b3631ac47 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:06.499701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262455-ec8b-4de9-83e4-107b3631ac47 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:06.502113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 223/445] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:06.510682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae67a63-693a-4757-95c5-8c9a055cbafd None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:06.511084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae67a63-693a-4757-95c5-8c9a055cbafd None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:06.511313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae67a63-693a-4757-95c5-8c9a055cbafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:06.539253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-fae67a63-693a-4757-95c5-8c9a055cbafd None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:06.540400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fae67a63-693a-4757-95c5-8c9a055cbafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:06.549657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 223/446] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:06.572174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262455-ec8b-4de9-83e4-107b3631ac47 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:06.588638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262455-ec8b-4de9-83e4-107b3631ac47 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:06.594643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:06.595213 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:06.595496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:06.595771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:06.596754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:06.621393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:06.621393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:31:06.621393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:31:06.622244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f80f3-8203-46f2-85a1-efd2c7c87575 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:06.642751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 224/447] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:31:06 2022] POST /identity/v3/services => generated 269 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:31:08.638429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027250d-c15f-4bae-9457-78b8e3918dca None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.639017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027250d-c15f-4bae-9457-78b8e3918dca None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.639017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027250d-c15f-4bae-9457-78b8e3918dca None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.640995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 224/448] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:08.649390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.650068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.650253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.677302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:08.678416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:08.696882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:08 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:08.719323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027250d-c15f-4bae-9457-78b8e3918dca None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:08.741213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027250d-c15f-4bae-9457-78b8e3918dca None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:08.749500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:08.750400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.750721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.750997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.751626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:08.777001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:08.788864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 18:31:08.789938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 225/450] 10.222.0.18 () {56 vars in 1153 bytes} [Mon Feb 28 18:31:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:08.798377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:08.807771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a358e-3993-4d2d-b75d-9e4683c64898 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:08.813750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:08.814352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.814666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.814953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.815639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:08.815942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:08.841538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:08.846855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 226/451] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:31:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:08.852786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:08.863816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d3213-fb72-46a1-88b2-1d81a3c9de66 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:08.869571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:08.870153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.870433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.870754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.871423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:08.871714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:08.897680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:08.903039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 226/452] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:31:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:08.911610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:08.925454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3259d-1f9f-418a-b3be-f60222ea0f4b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:08.931337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:08.931914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.932201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.932478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.933228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] RBAC: Adding query filter params (interface=public, service_id=427a5d03609c42b6b6fe97098fdeafb0, region_id=RegionOne) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:08.933530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:08.958498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:08.958498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:31:08.958498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:31:08.959387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb349f8-8a3d-439b-a9ed-95b8ed832af1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:08.965568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:31:08 2022] GET /identity/v3/endpoints?service_id=427a5d03609c42b6b6fe97098fdeafb0&interface=public®ion_id=RegionOne => generated 194 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:08.971958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:08.987006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa2a7-9802-4424-9389-c8b3baf26c5b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:08.992896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73d5eb-9922-4646-b6a7-789795e6c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:08.993472 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73d5eb-9922-4646-b6a7-789795e6c4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:08.993752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73d5eb-9922-4646-b6a7-789795e6c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:08.994023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73d5eb-9922-4646-b6a7-789795e6c4a5 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:08.994695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73d5eb-9922-4646-b6a7-789795e6c4a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:09.020452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73d5eb-9922-4646-b6a7-789795e6c4a5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:09.025615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:31:08 2022] GET /identity/v3/services => generated 562 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:11.012960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b080058-848e-44eb-adca-aa6d8e640531 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:11.013787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b080058-848e-44eb-adca-aa6d8e640531 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:11.013923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b080058-848e-44eb-adca-aa6d8e640531 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:11.016432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 228/455] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:11.021586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:11.022006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:11.022092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:11.045638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:11.047319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:11.055240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 228/456] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:11 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:11.077932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b080058-848e-44eb-adca-aa6d8e640531 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:11.099572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b080058-848e-44eb-adca-aa6d8e640531 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:11.107941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:11.109188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:11.109477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:11.109830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:11.110462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:11.135238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:11.135238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:31:11.135238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:31:11.136092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:11.147511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 18:31:11.148557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 229/457] 10.222.0.18 () {56 vars in 1153 bytes} [Mon Feb 28 18:31:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:11.154867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:11.167978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c915f8-37d8-4b0a-afba-3c8d4dae8737 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:11.173266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:11.173851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:11.174138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:11.174396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:11.175123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:11.175417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:11.200368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:11.208880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 229/458] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:31:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:11.214942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:11.225665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448c795-aee9-4704-9d99-48fba7e85579 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:11.230707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:11.231283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:11.231563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:11.231839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:11.232504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:11.232797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:11.257964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e83e69-2370-423a-b5f2-a7da02a02348 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:11.263285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 230/459] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:31:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:11.270984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:11.286641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261b0ed-6833-43b2-a61f-b91d02c13555 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:11.295134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:11.295997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:11.296408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:11.297132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:11.298227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:11.322777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:11.322777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:31:11.322777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:31:11.323639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcc0bc-b32e-4e5e-a2a4-f016dab63725 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:11.350353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 230/460] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:31:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:31:13.321597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde472-c712-4eb9-9ce3-5ed794dff799 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:13.322204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde472-c712-4eb9-9ce3-5ed794dff799 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:13.322204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fde472-c712-4eb9-9ce3-5ed794dff799 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:13.323849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 231/461] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:13.330030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:13.330844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:13.330999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:13.360532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:13.361686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:13.387477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 231/462] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:13 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:13.409983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde472-c712-4eb9-9ce3-5ed794dff799 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:13.425034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fde472-c712-4eb9-9ce3-5ed794dff799 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:13.430401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:13.431161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:13.431450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:13.431735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:13.432372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:13.462489 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:13.475261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 18:31:13.476425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 232/463] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:13.482530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:13.493663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5165fd-7319-4dbd-ab88-1bed50a60f2e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:13.499740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:13.500832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:13.501225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:13.501581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:13.502667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:13.503052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:13.530389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd0852-4d02-4ae3-8af7-92aa7de6b678 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:13.535878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:31:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:13.543686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:13.555263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5758e6a-5e4b-489a-9d24-ad782a07ecd6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:13.560934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:13.561489 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:13.561796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:13.562089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:13.563126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:13.563627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:13.594364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e6a7e-700d-41da-a6ad-b125e0810d55 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:13.600087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:31:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:15.636044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767f49-b509-43c9-9657-5325f352edfc None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:15.636923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767f49-b509-43c9-9657-5325f352edfc None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:15.636923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767f49-b509-43c9-9657-5325f352edfc None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:15.639666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 233/466] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:15.644915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1869dc-e257-47cf-a772-5b6ba38b20a1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:15.645352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1869dc-e257-47cf-a772-5b6ba38b20a1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:15.645442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1869dc-e257-47cf-a772-5b6ba38b20a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:15.669435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-eb1869dc-e257-47cf-a772-5b6ba38b20a1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:15.670539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-eb1869dc-e257-47cf-a772-5b6ba38b20a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:15.678895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 234/467] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:15 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:15.700530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767f49-b509-43c9-9657-5325f352edfc None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:15.720980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767f49-b509-43c9-9657-5325f352edfc None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:15.727288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:15.727867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:15.728151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:15.728424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:15.729101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:15.753826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:15.753826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:31:15.753826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:31:15.754723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbab52-4121-4760-bf44-b99a0f1a9970 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:15.772503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 234/468] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:31:15 2022] POST /identity/v3/services => generated 242 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:31:17.733452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317c88-ed05-4a2e-9bd0-c3d29f27e15e None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:17.734002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317c88-ed05-4a2e-9bd0-c3d29f27e15e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:17.734002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317c88-ed05-4a2e-9bd0-c3d29f27e15e None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:17.735985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 235/469] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:17.742294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:17.743035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:17.743209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:17.769639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:17.770807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:17.789748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 235/470] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:17 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:17.814089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a317c88-ed05-4a2e-9bd0-c3d29f27e15e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:17.831651 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a317c88-ed05-4a2e-9bd0-c3d29f27e15e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:17.836842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:17.837553 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:17.837841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:17.838120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:17.838777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:17.864503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:17.875641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 18:31:17.876708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 236/471] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:17.883167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:17.895334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bf074-8620-426f-a2a6-5f6582057176 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:17.901247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:17.901834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:17.902118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:17.902395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:17.903111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:17.903413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:17.928979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:17.933469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 236/472] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:31:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:17.941782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:17.955468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137b64a-cb76-4bf1-8406-d1c9a2273b66 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:17.961410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:17.961991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:17.962277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:17.962576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:17.963258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:17.963554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:17.992551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:17.998202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 237/473] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:31:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:18.005216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:18.018678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49034eb-606a-40df-bdba-86ae9708e058 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:18.023953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:18.028670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:18.030609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:18.032831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:18.034746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] RBAC: Adding query filter params (interface=public, service_id=a6789c90ba684f1baa56eb4dd8916670, region_id=RegionOne) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:18.035059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:18.059762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:18.059762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:31:18.059762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:31:18.060663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1fcbe-f4f7-41ab-8b90-8be02cf314b5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:18.067468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 237/474] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:31:18 2022] GET /identity/v3/endpoints?service_id=a6789c90ba684f1baa56eb4dd8916670&interface=public®ion_id=RegionOne => generated 194 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:18.076731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:18.087177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d990a7-7037-405e-8283-f350ef214e11 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:18.092493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca83bcb-eb3e-4a34-a010-c8ed1a88ab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:18.094641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca83bcb-eb3e-4a34-a010-c8ed1a88ab83 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:18.094641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca83bcb-eb3e-4a34-a010-c8ed1a88ab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:18.094641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca83bcb-eb3e-4a34-a010-c8ed1a88ab83 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:18.094641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca83bcb-eb3e-4a34-a010-c8ed1a88ab83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:18.120070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca83bcb-eb3e-4a34-a010-c8ed1a88ab83 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:18.125873 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 238/475] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:31:18 2022] GET /identity/v3/services => generated 792 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:20.158516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb608b-2d6f-4f21-8a19-d6fd2c18bb91 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:20.159464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb608b-2d6f-4f21-8a19-d6fd2c18bb91 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:20.159464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb608b-2d6f-4f21-8a19-d6fd2c18bb91 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:20.162182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 238/476] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:20.167725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:20.168159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:20.168281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:20.191346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:20.192475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:20.199448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 239/477] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:20 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:20.222500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb608b-2d6f-4f21-8a19-d6fd2c18bb91 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:20.240597 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb608b-2d6f-4f21-8a19-d6fd2c18bb91 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:20.244600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:20.245311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:20.245596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:20.245872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:20.246496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:20.272328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:20.283583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 18:31:20.284672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 239/478] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:20.294148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:20.304055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a20abe-73e4-4e45-90cb-260160e6d6e0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:20.310176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:20.310819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:20.311106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:20.311385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:20.312073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:20.312372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:20.337498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:20.343022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 240/479] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:31:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:20.350268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:20.363652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4ded0-834a-4be9-85ec-1d7afbf1e297 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:20.368899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:20.369514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:20.369794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:20.370065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:20.370758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:20.371063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:20.396379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fc9de-fea9-4a15-a87c-d1977d38d262 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:20.401570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 240/480] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:31:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:20.410948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:20.428811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1673-708c-48b4-8dfc-df53575899f3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:20.430594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:20.431197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:20.431483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:20.431767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:20.432451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:20.457191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:31:20.457191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:31:20.457191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:31:20.458056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf5e80-7a41-4477-a826-fdeb0dd71e68 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:20.482949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 241/481] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:31:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:31:22.536473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8355367-20cc-4f27-8b4e-23f63e589b63 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.537005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8355367-20cc-4f27-8b4e-23f63e589b63 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.537005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8355367-20cc-4f27-8b4e-23f63e589b63 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.538732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 241/482] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:22.544069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.544504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.544599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.568785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:22.569901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:22.587752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 242/483] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:22 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:22.611268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8355367-20cc-4f27-8b4e-23f63e589b63 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:22.632723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8355367-20cc-4f27-8b4e-23f63e589b63 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:22.640968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:22.641692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.641974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.642245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.655578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:22.662279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:31:22.663377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 242/484] 10.222.0.18 () {56 vars in 1141 bytes} [Mon Feb 28 18:31:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:22.671851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:22.680398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d811c2-d1d5-49fb-a272-1d664046c48e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:22.684842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:22.685468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.685760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.686029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.686854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:22.687153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:22.721336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:22.730669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 243/485] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:31:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:22.736831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:22.750743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a2a1-ad20-4678-9a45-e24afe632acc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:22.755313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:22.756027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.756328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.756585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.769047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:22.794740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:22.811410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:22.812554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 243/486] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:22.818096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:22.828139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392ca6-b4f4-4671-8176-64a994d39971 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:22.833269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:22.833848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.834138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.834424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.835127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:22.835431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:22.861195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:22.873985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 244/487] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:22.879958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:22.895721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce2af-b764-4fae-822c-c6ec2de1c5bc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:22.904319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:22.905421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:22.905896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:22.906178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:22.920092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:22.945406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:22.963530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:31:22.964603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:31:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:22.974280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:22.990433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aca41-1608-4dd3-9b27-10f8d910ac98 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:22.998787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:22.999961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.000085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.000317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.001118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:23.001416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.026832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.056397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 245/489] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:31:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:23.062614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:23.077704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22993da7-9939-41b6-879f-06daa129d2fd admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:23.082644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:23.083214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.083498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.083772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.092116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.118308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.129319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 245/490] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:23 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:23.137867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:23.148531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5312a21-be58-4b59-b690-b86e15e18258 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:23.153682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:23.154401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.154731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.155010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.167477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.193010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.210769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:23.211922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:23.217713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:23.227401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b36d35-6031-4049-8fd5-c8fa6a86da49 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:23.232788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:23.233364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.233790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.234184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.234980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:23.235273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.260827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.274479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:23.280649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:23.296964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c96f9-a097-46ae-827b-f119373e43ac admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:23.302125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:23.302867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.303150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.303422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.315007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.340220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.358422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:23.359774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 247/493] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:23.365539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:23.377179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc20ab-6677-4252-b406-d0139be6e791 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:23.381736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:23.382311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.382653 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.382923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.383664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:23.383963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.409234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba170-6389-4d5f-b27c-b0a68a0c261f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.423613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 247/494] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:23.430192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:23.442414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9efbb-6dd6-4030-a7c0-09c5008cca44 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:23.448121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:23.448694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:23.448979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:23.449256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:23.450033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] RBAC: Adding query filter params (role.id=9f954624047f48eba9c2b6b8be46d57e, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=2df0c8ccfb9944d4a8d0ccb4745bc714) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:23.450335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:23.475982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551cd71-f7e0-4c33-8ff9-b1e3d809489b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:23.482047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 248/495] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:23 2022] GET /identity/v3/role_assignments?user.id=2df0c8ccfb9944d4a8d0ccb4745bc714&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=9f954624047f48eba9c2b6b8be46d57e => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:25.416019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4acf-455d-4cef-9bb9-b7ff27630ade None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.416833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4acf-455d-4cef-9bb9-b7ff27630ade None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.416946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4acf-455d-4cef-9bb9-b7ff27630ade None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.419602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 248/496] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:25.425781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.426207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.426391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.459421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:25.460497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:25.468920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 249/497] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:25 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:25.491286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb4acf-455d-4cef-9bb9-b7ff27630ade None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.505516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb4acf-455d-4cef-9bb9-b7ff27630ade None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.510801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.511550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.511831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.512105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.525337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:25.532308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:31:25.533403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 249/498] 10.222.0.18 () {56 vars in 1141 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:25.539688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.551363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1593d3-c5b8-408a-9364-a03fa900ba49 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.556465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.557051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.557332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.557605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.558312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:25.558633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:25.584337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:25.593768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 250/499] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:25.599620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.610607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd99f1-33c7-46ba-9030-b3b5b428d06d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.615223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.615908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.616191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.616466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.627970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:25.653222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:25.670831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:25.672122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 250/500] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:25.678246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.694012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c6a90-13ff-410d-b9f8-9785e668cfa3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.702708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.703291 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.703575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.703856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.704541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:25.704838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:25.730198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:25.744309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 251/501] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:25.752781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.766701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4ada-8482-4694-9204-82ac047e81dc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.771887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.772579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.772856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.773124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.786074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:25.811524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:25.829594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:31:25.830638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 251/502] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:25.836779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.852856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2804ebe-1470-4fb6-a983-2339be0abcdf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.860270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.860861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.861144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.861423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.862216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:25.862516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:25.887671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:25.917759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 252/503] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:25.923954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:25.939537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0969-c369-437b-844a-57a0a1609ad5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:25.947333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:25.948417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:25.948887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:25.949350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:25.963096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:25.988887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:26.006429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:26.007516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 252/504] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:26.013069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:26.023189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f41c07-8f0d-471c-979d-3f6215ab2dbf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:26.028263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:26.028846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:26.029132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:26.029413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:26.030123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:26.030451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:26.055622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:26.069059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 253/505] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:26.075437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:26.091007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a74628-d1fa-45aa-ad61-c24314d121b7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:26.097755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:26.098460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:26.098771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:26.099024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:26.108511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:26.133642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:26.147565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:26.148642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 253/506] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:26.157453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:26.170214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7dbf5-bf78-4a96-84e0-028861ddf65b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:26.175130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:26.175701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:26.175988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:26.176267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:26.177019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:26.177319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:26.202931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba114a-1f46-4d68-be8c-ae8973106659 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:26.217277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 254/507] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:26.224115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:26.239299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44413-56b5-4bf1-82b4-65ad448be8dc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:26.245914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eacdba-1da0-4985-9135-fcc8215fe28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:26.247243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eacdba-1da0-4985-9135-fcc8215fe28a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:26.247568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eacdba-1da0-4985-9135-fcc8215fe28a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:26.248032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eacdba-1da0-4985-9135-fcc8215fe28a admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/2df0c8ccfb9944d4a8d0ccb4745bc714/roles/9f954624047f48eba9c2b6b8be46d57e` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:26.251368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eacdba-1da0-4985-9135-fcc8215fe28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=2df0c8ccfb9944d4a8d0ccb4745bc714, role_id=9f954624047f48eba9c2b6b8be46d57e)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:26.277315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eacdba-1da0-4985-9135-fcc8215fe28a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:26.299966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 254/508] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:31:26 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/2df0c8ccfb9944d4a8d0ccb4745bc714/roles/9f954624047f48eba9c2b6b8be46d57e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:31:28.240096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa62e-08ea-4119-83e0-b92756fc8748 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.240683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa62e-08ea-4119-83e0-b92756fc8748 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.240683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa62e-08ea-4119-83e0-b92756fc8748 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.242348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 255/509] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:28.247830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.248238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.248380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.273066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:28.274215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:28.344194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 255/510] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:28 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:28.378882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aa62e-08ea-4119-83e0-b92756fc8748 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.393578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aa62e-08ea-4119-83e0-b92756fc8748 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.398615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.399379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.399670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.399955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.412130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:28.418797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:31:28.419884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 256/511] 10.222.0.18 () {56 vars in 1141 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:28.426012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.437455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c34838-8b3f-4029-8a0d-e4c60a865f06 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.443470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.444073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.444359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.444633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.445356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:28.445658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.471450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.480799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:28.489740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.504098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7e6b-7b3d-4a7d-a30c-3882af920d86 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.509430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.510138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.510420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.510700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.523548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.549044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.566595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:28.567689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 257/513] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:28.573866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.590080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b428-af8e-4329-9098-150151c77e0e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.596677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.597291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.597576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.597853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.598546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:28.598884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.624045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.638033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:28.646307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.656811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aab462-7b05-4ae8-8c3e-143f4099b122 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.661397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.662102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.662394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.662707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.676195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.701870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.720375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 18:31:28.721869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 258/515] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:28.730189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.740219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d273420-1181-433f-bf65-900b0dedb341 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.745291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.745876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.746171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.746446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.747280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:28.747583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.773634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.806137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 258/516] 10.222.0.18 () {56 vars in 1154 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:28.815111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.829627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e56ec-2127-4d27-9480-c405f8951dda admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.835340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.835906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.836185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.836459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.845080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.870661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.878906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 259/517] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:28.887337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.898529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e10197-4662-45c7-92a1-3cb1897b0ee3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.904522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.905266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.905519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.905798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.919239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:28.948134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:28.966408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:28.967557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 259/518] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:28.973771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:28.984098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c668-cbec-4055-b073-0bbe6d7e4b9d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:28.992411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:28.993256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:28.993619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:28.993955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:28.995027 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:28.995417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:29.027968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:29.041288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 260/519] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:29.047496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:29.062312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5ecd4-e4fc-4dec-a97a-228a54d1fbb8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:29.067618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:29.068326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:29.068607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:29.068881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:29.078362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:29.104253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:29.118257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:29.119332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 260/520] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:29.126849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:29.137305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40ed74-575f-46dd-bf4e-931853875fde admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:29.143500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:29.144086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:29.144373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:29.144649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:29.145401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:29.145706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:29.171392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e760de-0319-4585-80b1-e5e7389c8807 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:29.185024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 261/521] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:29.190985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:29.200785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2201c-6b36-469d-8481-a2049fa6b119 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:29.206034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:29.206726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:29.207073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:29.207416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:29.208261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] RBAC: Adding query filter params (role.id=9f954624047f48eba9c2b6b8be46d57e, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=2df0c8ccfb9944d4a8d0ccb4745bc714) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:29.208628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:29.237161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6bec9-295f-44c6-b3d9-f538da4446cc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:29.243704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 261/522] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:29 2022] GET /identity/v3/role_assignments?user.id=2df0c8ccfb9944d4a8d0ccb4745bc714&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=9f954624047f48eba9c2b6b8be46d57e => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:31.350525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849a41-a469-4043-9f9e-bb63c10f70b7 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:31.351426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849a41-a469-4043-9f9e-bb63c10f70b7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:31.351559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5849a41-a469-4043-9f9e-bb63c10f70b7 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:31.354147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 262/523] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:31.360530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:31.361242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:31.361377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:31.390049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:31.391232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:31.398789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 262/524] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:31 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:31.422923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5849a41-a469-4043-9f9e-bb63c10f70b7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:31.442267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5849a41-a469-4043-9f9e-bb63c10f70b7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:31.446159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:31.446901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:31.447187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:31.447466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:31.459407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:31.488771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:31.505079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:31.506232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 263/525] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:31.516267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:31.530146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac0da-f3e0-4037-9b33-77497ac398a7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:31.536095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:31.536684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:31.536967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:31.537236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:31.537922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:31.538214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:31.563341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17595627-5a29-4a7e-ab27-8460f14e4de0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:31.577228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 263/526] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:31.583287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:31.594026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e5908-4553-4561-a1af-ad56a09b623c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:31.599923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c61e1-225d-4e5b-97ab-adb750dfad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:31.600540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c61e1-225d-4e5b-97ab-adb750dfad26 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:31.600825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c61e1-225d-4e5b-97ab-adb750dfad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:31.601097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c61e1-225d-4e5b-97ab-adb750dfad26 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:31.601747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c61e1-225d-4e5b-97ab-adb750dfad26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:31.627268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c61e1-225d-4e5b-97ab-adb750dfad26 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:31.656862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 264/527] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:31:31 2022] POST /identity/v3/users => generated 248 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:31:33.641500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620bd2-d864-4721-86c3-442d149c378f None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:33.642056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620bd2-d864-4721-86c3-442d149c378f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:33.642056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58620bd2-d864-4721-86c3-442d149c378f None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:33.643748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 264/528] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:33.650079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:33.650850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:33.650983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:33.677008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:33.678144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:33.685932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 265/529] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:33 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:33.720796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58620bd2-d864-4721-86c3-442d149c378f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:33.734253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58620bd2-d864-4721-86c3-442d149c378f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:33.739234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:33.739936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:33.740221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:33.740480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:33.752212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:33.758456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:31:33.759589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 265/530] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:31:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:33.766300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:33.781250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f4dc3-f7f6-4c39-859c-076c7c0d11b1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:33.787280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:33.787883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:33.788164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:33.788435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:33.789164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:33.789460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:33.815040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:33.824549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 266/531] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:31:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:33.833677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:33.848125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ed924-f2b0-43bf-ab50-819405b3b910 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:33.854056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:33.854794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:33.855075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:33.855354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:33.868253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:33.893750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:33.912186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:33.913279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 266/532] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:33.920074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:33.936608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2998f-108a-4325-ac0c-43a2028a08e6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:33.942583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:33.943174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:33.943465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:33.943742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:33.944433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:33.944731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:33.970116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:33.984541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 267/533] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:33.993417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.009799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026db68c-bc35-4417-8287-c487995801e2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.017278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.017986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.018272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.018542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.032264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.058261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.077148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 18:31:34.078503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 267/534] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:31:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:34.085566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.098370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3eb50-04ad-443d-a72b-8ae460c71e69 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.107081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.108458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.108822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.109096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.109934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:34.110231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.135653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.165817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 268/535] 10.222.0.18 () {56 vars in 1158 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:34.171703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.181508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075625b-e1e7-4866-92d5-de8792893510 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.186797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.187368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.187651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.187924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.196121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.223046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.232951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 268/536] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:34.238915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.248307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93c4c4-fcb1-4c23-852a-d4056f3d2717 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.253247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.253956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.254239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.254515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.266255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.291695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.309362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:34.310464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 269/537] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:34.316637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.325906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43785d0-4c50-4d3d-ae01-642da62a6501 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.332393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.332980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.333259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.333529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.334212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:34.334502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.361245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.376224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 269/538] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:34.385441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.401538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62884c8-b506-4e22-bdce-ca7deb316edc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.408893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.409614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.409906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.410173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.420378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.445794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.459937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:34.461060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 270/539] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:34.467918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.484053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a4f28-ab36-4d0b-a028-74c693978546 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.492214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.493158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.493636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.494100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.495412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:34.495934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.522647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59926c51-23d0-483e-b039-944e322b2915 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.536487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 270/540] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:34.546065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:34.561272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490dad-978a-45e9-acd1-8c1a4339fce4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:34.569113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:34.569940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:34.570277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:34.570626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:34.571752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=b3caf8a53d924849b5cb756249a1a96f) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:34.572059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:34.605334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8178a9c-6ed8-4057-b886-f3910ee5e9a3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:34.611825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 271/541] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:34 2022] GET /identity/v3/role_assignments?user.id=b3caf8a53d924849b5cb756249a1a96f&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:36.588897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473623-d834-41e7-8d96-dbc67e0dd6da None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.589788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473623-d834-41e7-8d96-dbc67e0dd6da None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.589788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41473623-d834-41e7-8d96-dbc67e0dd6da None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.592577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 271/542] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:36.598767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.599178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.599336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.624012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:36.625159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:36.632219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 272/543] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:36 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:36.659027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473623-d834-41e7-8d96-dbc67e0dd6da None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:36.673163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41473623-d834-41e7-8d96-dbc67e0dd6da None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:36.677887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:36.678589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.678903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.679180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.692410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:36.698692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:31:36.699754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 272/544] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:36.706923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:36.719745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8a2e-e84b-408c-ba7b-fc30d3bc92d4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:36.726185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:36.726812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.727100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.727371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.728089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:36.728384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:36.753918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:36.763314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 273/545] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:36.772376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:36.786202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ede4c-1199-4b06-9040-3c355ca5bc7a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:36.791582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:36.792282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.792565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.792838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.805798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:36.831112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:36.849075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:36.850064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:36.856429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:36.872301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22c4c0-db32-4ae7-a0a5-e6c9111b7a59 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:36.878343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:36.878961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.879240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.879514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.880205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:36.880496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:36.905652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:36.919554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 274/547] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:36.928274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:36.941797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7836d-aa90-4709-86b9-f893ac96b587 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:36.947282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:36.947993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:36.948275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:36.948544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:36.966992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:36.992954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.011503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 18:31:37.012587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 274/548] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:31:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:37.019377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:37.034736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34075-49a0-45d6-81e4-7a320bc0d57f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:37.042748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:37.043716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:37.044187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:37.044652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:37.046005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:37.046298 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:37.071440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.102208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 275/549] 10.222.0.18 () {56 vars in 1158 bytes} [Mon Feb 28 18:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:37.110496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:37.120397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d82aa-bafc-4aa9-8ba4-b4a0de3eefe2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:37.126319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:37.127046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:37.127321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:37.127588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:37.140815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:37.166589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.183870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:37.184955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 275/550] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:37.191010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:37.200356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f18a77-aa72-462a-9cca-6266b4d4b297 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:37.205393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:37.205976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:37.206260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:37.206541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:37.207252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:37.207543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:37.233571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.246895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 276/551] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:37.253505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:37.267783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcc92b-39c9-4d8f-9627-dcaa86ac81fa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:37.273895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:37.274604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:37.274913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:37.275179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:37.285355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:37.310781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.330346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:37.332111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:37.338224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:37.350411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9e8f-9690-4a24-8909-2789344fee68 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:37.354869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:37.355396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:37.355681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:37.355961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:37.356705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:37.357003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:37.382672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f9fbf-6e09-45b9-bcf5-d1af95b8415a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.398398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:37.404361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:37.414188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050239b4-397e-4456-81ed-68c05c6e7d23 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:37.418734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c86d4-7d8b-40bf-944c-f98eeb0cf3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:37.419558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c86d4-7d8b-40bf-944c-f98eeb0cf3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:37.419841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c86d4-7d8b-40bf-944c-f98eeb0cf3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:37.420111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c86d4-7d8b-40bf-944c-f98eeb0cf3f1 admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/b3caf8a53d924849b5cb756249a1a96f/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:37.441093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c86d4-7d8b-40bf-944c-f98eeb0cf3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=b3caf8a53d924849b5cb756249a1a96f, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:37.466962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c86d4-7d8b-40bf-944c-f98eeb0cf3f1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:37.486296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 277/554] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:31:37 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/b3caf8a53d924849b5cb756249a1a96f/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:31:39.445494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c020be9-7cd1-4bda-894c-d4622eeb8704 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.446331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c020be9-7cd1-4bda-894c-d4622eeb8704 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.446331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c020be9-7cd1-4bda-894c-d4622eeb8704 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.449114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 278/555] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:39.454522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.454973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.455062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.479642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:39.480714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:39.553081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 278/556] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:39 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:39.575940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c020be9-7cd1-4bda-894c-d4622eeb8704 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:39.596252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c020be9-7cd1-4bda-894c-d4622eeb8704 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:39.601972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:39.602726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.603015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.603280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.616079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:39.622299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:31:39.623427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:39.632106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:39.640692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc8a29-1501-44b5-b862-b6e020ee9fc3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:39.645235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:39.645818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.646104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.646386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.647135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:39.647439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:39.672579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:39.681016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:39.687060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:39.706340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33010-dd7c-40aa-a0e9-ec2a18532cba admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:39.715117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:39.716230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.716697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.717397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.729715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:39.755042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:39.773348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:39.774401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:39.783425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:39.798665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8694c-82de-4814-992a-a3e4ed0cf50a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:39.806777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:39.807696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.808153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.808584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.809699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:39.810177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:39.835854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:39.849891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:39.856189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:39.876091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49211b-e53e-43a4-8ce2-804f82c84e3f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:39.881114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:39.881830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.882119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.882342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.895969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:39.921328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:39.939026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 18:31:39.940115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:31:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:39.949443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:39.960643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c7ff9-a3b9-4778-81dd-0a31f18fbe8b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:39.965982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:39.966594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:39.966903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:39.967185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:39.968129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:39.968500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:39.997237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.029289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1158 bytes} [Mon Feb 28 18:31:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:40.035381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:40.049813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6eb7dd-ab45-4cac-bf5c-138e7b2c25c7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:40.055026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:40.055747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:40.056094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:40.056408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:40.065202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:40.097162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.106471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 282/563] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:40 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:40.115844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:40.129214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f647b-fcd8-4b78-a2c0-8654b3b8818f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:40.135765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:40.136730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:40.137483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:40.137483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:40.151269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:40.177280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.195044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:40.196283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:40.202586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:40.211093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dd91b-8523-45af-be7f-81c84a074229 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:40.215360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:40.215965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:40.216253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:40.216547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:40.217317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:40.217627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:40.243598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.257645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:40.263326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:40.278112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8766-7c13-4612-bb29-27b3ba1773aa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:40.285258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:40.285971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:40.286256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:40.286531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:40.296565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:40.322453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.337023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:40.338096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:40.346598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:40.361494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26fade-160d-4d07-b6a4-9bb50b47c56b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:40.369437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:40.370367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:40.370885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:40.371342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:40.372485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:40.372971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:40.398391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7aa57-39ee-4de8-98c9-aceca9398a8b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.412916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:40.422125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:40.437381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614f44-2f6a-481d-99e1-6386c961949f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:40.443111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:40.443687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:40.443971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:40.444254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:40.445045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=b3caf8a53d924849b5cb756249a1a96f) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:40.445347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:40.471136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097b14f-fc14-4243-bfe1-3c8f23e12820 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:40.477862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:40 2022] GET /identity/v3/role_assignments?user.id=b3caf8a53d924849b5cb756249a1a96f&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:42.521208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe2f1-0939-44dc-8b7d-d1d47a5eacb1 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:42.522035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe2f1-0939-44dc-8b7d-d1d47a5eacb1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:42.522035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe2f1-0939-44dc-8b7d-d1d47a5eacb1 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:42.524980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 285/569] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:42.533713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:42.534141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:42.534279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:42.563268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:42.564394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:42.572378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 285/570] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:42 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:42.604577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fe2f1-0939-44dc-8b7d-d1d47a5eacb1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:42.625166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fe2f1-0939-44dc-8b7d-d1d47a5eacb1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:42.630377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:42.631115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:42.631399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:42.631677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:42.644694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:42.670028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:42.687881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:42.688934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:42.697832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:42.711425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c39084-9563-4fcb-9392-8bcf0ba02855 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:42.719133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:42.719713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:42.720311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:42.720585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:42.721273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:42.721565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:42.746718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d777c-5b11-42c8-b7f9-4569a5051990 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:42.761191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:42.767890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:42.782512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647c8e8-686b-4be4-a49f-638d3a155b75 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:42.787612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203dcee-536d-4014-994a-a05f02067627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:42.788198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203dcee-536d-4014-994a-a05f02067627 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:42.788484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203dcee-536d-4014-994a-a05f02067627 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:42.788763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203dcee-536d-4014-994a-a05f02067627 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:42.789409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203dcee-536d-4014-994a-a05f02067627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:42.815116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203dcee-536d-4014-994a-a05f02067627 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:42.842883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 287/573] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:31:42 2022] POST /identity/v3/users => generated 254 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:31:44.846024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2e03-3df7-4c46-afc9-0d3a6a5a399c None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:44.846993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2e03-3df7-4c46-afc9-0d3a6a5a399c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:44.846993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2e03-3df7-4c46-afc9-0d3a6a5a399c None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:44.849675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 287/574] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:44.855921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:44.856633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:44.856782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:44.885447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:44.886598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:44.893639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 288/575] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:44 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:44.917120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2e03-3df7-4c46-afc9-0d3a6a5a399c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:44.937654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2e03-3df7-4c46-afc9-0d3a6a5a399c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:44.942751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:44.943461 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:44.943744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:44.944022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:44.956007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:44.962268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:31:44.963368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 288/576] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:31:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:44.970591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:44.979326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1655-5bf4-498c-92ae-bc29c0c3b532 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:44.985029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:44.985608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:44.985889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:44.986161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:44.986905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:44.987201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.019951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.029528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:31:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:45.035406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.045959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d09a4-4c1a-4470-8143-256ce00acff9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.051087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.051800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.052081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.052354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.064305 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.090321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.109211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:45.110237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 289/578] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:45.116776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.129294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7367e9-4e0b-41b0-89e4-8b037798ce22 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.134187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.134806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.135095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.135371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.136069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:45.136369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.161856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.176269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 290/579] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:45.181965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.191631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4165044-dda5-456f-b3c7-704d63403bbd admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.196086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.196812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.197094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.197371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.210205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.236275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.255408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:31:45.256516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 290/580] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:45.262927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.277150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13458-cd4e-4505-90f8-90b3dfefc993 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.284413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.285363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.285832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.286281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.287638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:45.288127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.316146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.345914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 291/581] 10.222.0.18 () {56 vars in 1170 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:45.354941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.366515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca4a8c-f36a-49bb-9188-9988bf7c0b4e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.371904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.372487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.375898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.375898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.386071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.412945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.421767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 291/582] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:45.430813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.447347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7d91f-1d6f-4e8b-924c-1d8b5d664d97 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.454167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.454916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.455197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.455490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.468017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.493560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.511835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:45.512903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 292/583] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:45.522845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.537110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dde5d-82e9-40e9-9085-d39f42b6f246 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.544708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.547321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.547613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.547919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.548606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:45.548877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.573981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.588167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 292/584] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:45.596926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.607065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac7c04-4f87-4675-b446-45ae816f1df4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.612389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.613093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.613382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.613659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.624820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.649882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.664170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:45.665209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 293/585] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:31:45.674377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.688807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78e42-910c-4593-adb0-6056eaa1f1e6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.694586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.695174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.695459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.695729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.696476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:45.696769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.722270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebdbc2-98f7-4f8c-9c40-21274acd1912 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.739781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 293/586] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:45.749069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:45.759075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c509b-0bb0-4cb9-bf27-02b94ac0ed2c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:45.764831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:45.765396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:45.765680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:45.765954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:45.766782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=8f45fc4f68f64c9a834fe0ccae08350a) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:45.767202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:45.792546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9eead-391b-4c1f-af35-b9a1888743a5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:45.798495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:45 2022] GET /identity/v3/role_assignments?user.id=8f45fc4f68f64c9a834fe0ccae08350a&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:47.757512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58b04-d507-4fd5-b59c-2d81b67692fb None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:47.758058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58b04-d507-4fd5-b59c-2d81b67692fb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:47.758173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58b04-d507-4fd5-b59c-2d81b67692fb None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:47.760783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 294/588] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:47.768135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:47.768616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:47.768721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:47.793869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:47.795179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:47.802802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 295/589] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:47 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:47.825228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58b04-d507-4fd5-b59c-2d81b67692fb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:47.839046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58b04-d507-4fd5-b59c-2d81b67692fb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:47.843963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:47.845022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:47.845315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:47.845590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:47.856906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:47.863244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:31:47.864348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 295/590] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:31:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:47.870747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:47.881071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2f20d-c769-4501-8e9e-c45b33f61bc8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:47.886458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:47.887093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:47.887378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:47.887652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:47.888367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:47.888663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:47.914004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:47.923190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 296/591] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:31:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:47.932153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:47.942630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940bafd-22a7-400e-9d5d-42cd36db3430 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:47.947038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:47.947762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:47.948042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:47.948322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:47.959605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:47.985335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.002817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:48.003880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 296/592] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:48.009522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.019473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57a82e-d18e-48e2-b10b-89ea5b8c6079 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.024601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.025177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.025462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.025745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.026427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:48.026751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.051745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.065881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 297/593] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:48.071948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.089038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070af69-61bc-4ca0-bb8a-ceb76f37ad1a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.096438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.097159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.097435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.097707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.112947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.141579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.161467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:31:48.162548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 297/594] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:48.169674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.179774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375ca82-38d0-4414-a24b-be2dc3d3c019 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.185082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.187142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.188662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.188662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.189445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:48.189752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.216364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.248207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 298/595] 10.222.0.18 () {56 vars in 1170 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:48.255267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.268961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a98ae4-56d3-4000-ba38-1c8b829b6319 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.274854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.275563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.275847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.276124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.290413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.315937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.334602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:48.336434 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 298/596] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:48.348252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.361392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3a9b7-99eb-45a1-bfff-38fd9ffdba36 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.366705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.367286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.367569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.367851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.368566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:48.368858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.404803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.422591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 299/597] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:48.429337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.446438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee6dd-022f-419e-9eff-4c131b8fd2fb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.453630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.454338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.454708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.454982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.464552 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.490192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.504418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:48.505475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 299/598] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:48.514439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.524422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276dae-7dd4-47c7-b160-3d21d04af088 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.530292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.530904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.531194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.531462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.532218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:48.532516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.558186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34c676-db0d-4fe1-8e77-9ad572358aef admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.573832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 300/599] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:48.580003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:48.590212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50677413-9b33-46f7-82bf-86e3ada710b4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:48.595508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96fc45-3152-4051-a6eb-01ea49dd7b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:48.596366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96fc45-3152-4051-a6eb-01ea49dd7b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:48.596643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96fc45-3152-4051-a6eb-01ea49dd7b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:48.596927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96fc45-3152-4051-a6eb-01ea49dd7b97 admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/8f45fc4f68f64c9a834fe0ccae08350a/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:48.618525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96fc45-3152-4051-a6eb-01ea49dd7b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=8f45fc4f68f64c9a834fe0ccae08350a, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:48.644818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96fc45-3152-4051-a6eb-01ea49dd7b97 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:48.667148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 300/600] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:31:48 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/8f45fc4f68f64c9a834fe0ccae08350a/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:31:50.638340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d11b-11ba-43cd-a8f9-0a20e1e2a9ef None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:50.639326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d11b-11ba-43cd-a8f9-0a20e1e2a9ef None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:50.639326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d11b-11ba-43cd-a8f9-0a20e1e2a9ef None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:50.642149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 301/601] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:50.650740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:50.651414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:50.651667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:50.682284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:50.683448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:50.751769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 301/602] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:50 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:50.775216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265d11b-11ba-43cd-a8f9-0a20e1e2a9ef None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:50.796133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265d11b-11ba-43cd-a8f9-0a20e1e2a9ef None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:50.801398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:50.802126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:50.802415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:50.802717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:50.815161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:50.821422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:31:50.822507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 302/603] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:50.831563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:50.844374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9f03-80ca-4eb2-8105-b800f26127e8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:50.850690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:50.851274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:50.851555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:50.851823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:50.852550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:50.852844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:50.878608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:50.888117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 302/604] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:31:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:50.894471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:50.909406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11125-4538-40c9-8f8e-a207eb2bddec admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:50.915361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:50.916050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:50.916334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:50.916603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:50.933241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:50.970168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:50.989004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:50.990072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 303/605] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:50.998153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.013112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf29dc-9989-45f9-8118-80c8d9f6dce0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.020285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.021154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.021516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.021859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.023031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:51.023441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.050921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.069997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 303/606] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:51.075915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.086034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cef78b-00f8-40bf-b9aa-152b38a24956 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.091258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.092241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.092583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.092843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.106581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.132255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.158585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:31:51.159632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 304/607] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:51.165558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.175371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448807-6056-4c2a-a667-4c4658d10146 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.179704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.180284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.180567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.180836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.181620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:51.181914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.207407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.238366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 304/608] 10.222.0.18 () {56 vars in 1170 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:51.244872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.261285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfaa75-1de8-4d72-9c85-91b1977ad992 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.267654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.268260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.268554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.268839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.277075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.302654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.311575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 305/609] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:51.318716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.331935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe499-9de0-44a6-8082-46bf78f5f908 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.337980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.338732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.339035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.339314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.353102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.378346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.395269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:51.396337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 305/610] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:51.405383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.419694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1891b6e-8367-4275-9f49-7eafb50e0f6b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.425719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.426297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.426586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.426880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.427564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:51.427860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.453230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.472289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 306/611] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:51.480369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.490467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8654a3-d023-477b-9918-ae9e8bcd00cb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.495636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.496336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.496621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.496904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.506198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.531609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.545834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:51.546917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 306/612] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:31:51.555989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.567959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01d921-54ae-4fce-ab62-d0e9e8e0070d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.573608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.574193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.574474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.574778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.575522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:51.575820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.603019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebb07-a92b-486a-a934-5d1dc2b76cd3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.618295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 307/613] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:51.625022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:51.640848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639512d6-6ec3-40df-9b8e-2b0ea13d313f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:51.649394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:51.650317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:51.650795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:51.651696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:51.652494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=8f45fc4f68f64c9a834fe0ccae08350a) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:51.652990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:51.678980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd326b-92ba-4349-b89c-ea2f49a153dc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:51.684876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 307/614] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:51 2022] GET /identity/v3/role_assignments?user.id=8f45fc4f68f64c9a834fe0ccae08350a&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:53.752292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913b926-d0ee-472d-977a-a01c7f6f1c66 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:53.753183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913b926-d0ee-472d-977a-a01c7f6f1c66 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:53.753183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913b926-d0ee-472d-977a-a01c7f6f1c66 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:53.756007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 308/615] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:53.761262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:53.761687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:53.761794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:53.787198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:53.788343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:53.796888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 308/616] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:53 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:53.819848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913b926-d0ee-472d-977a-a01c7f6f1c66 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:53.841841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913b926-d0ee-472d-977a-a01c7f6f1c66 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:53.847227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:53.847958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:53.848241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:53.848515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:53.861653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:53.868384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:31:53.869499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 309/617] 10.222.0.18 () {56 vars in 1141 bytes} [Mon Feb 28 18:31:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:53.878763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:53.892723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451224e-9e12-44dc-bc20-79fc1379dbb3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:53.900975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:53.901885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:53.902287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:53.902735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:53.903863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:53.904428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:53.929584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:53.938979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 309/618] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:31:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:53.944674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:53.955299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff53f7-7d79-48e7-9d5c-c80cb14cba72 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:53.960376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:53.961075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:53.961356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:53.961627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:53.973660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:53.999457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.018719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:54.019694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 310/619] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:54.025247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.035308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37d87-9e6b-4487-bdb0-1f4d4364acd0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.040342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.040907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.041188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.041462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.042147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:54.042437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.067434 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.081142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 310/620] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:54.087199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.099572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec405-39a1-45ec-a7b6-ae33c8bc0bd9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.104803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.105521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.105799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.106070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.119650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.146037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.164329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:31:54.165402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 311/621] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:54.174615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.189684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b5aba-4c1f-4843-a7b7-afcc133847bb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.195028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.195706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.196071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.196408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.197257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:54.197628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.223420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.260352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 311/622] 10.222.0.18 () {56 vars in 1170 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:54.267391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.281662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01641-0222-4cbd-9bc2-c2e941ee0e37 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.290353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.291295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.291746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.292185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.301595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.327314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.336291 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 312/623] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:31:54.345959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.360224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab878af-f0f0-4007-84c5-70c8a3317fac admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.365525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.366247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.366537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.366858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.378652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.404184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.423434 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:54.425044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 312/624] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:54.432161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.446227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacd3fa-0e4a-46a9-8b5f-99fc07519415 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.453753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.454338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.454648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.454927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.455613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:54.455908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.481495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.496109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 313/625] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:54.505129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.518115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981237-a0d9-4f91-a912-f79ba31e01de admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.523034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.523746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.524033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.524311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.533430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.558881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.573081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:54.574141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 313/626] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:54.580635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.596178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77da016-cf05-48c6-a531-9fd78089ef09 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.604097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.604968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.605386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.605814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.607042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:54.607616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.639585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5071e3-6cbd-45cb-9037-ce340a468337 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.654808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 314/627] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:54.664201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:54.680172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dbc06-524c-4fac-bdec-cfc7eec884ed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:54.687739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:54.688312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:54.688603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:54.688879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:54.689659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] RBAC: Adding query filter params (role.id=9f954624047f48eba9c2b6b8be46d57e, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=8f45fc4f68f64c9a834fe0ccae08350a) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:54.689961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:54.715238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e2a2-30f8-4dab-ba11-6b4be00fe38f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:54.722282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 314/628] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:31:54 2022] GET /identity/v3/role_assignments?user.id=8f45fc4f68f64c9a834fe0ccae08350a&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=9f954624047f48eba9c2b6b8be46d57e => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:56.673336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa305be-72bd-408a-b4fb-169034ab0ace None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:56.674177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa305be-72bd-408a-b4fb-169034ab0ace None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:56.674177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa305be-72bd-408a-b4fb-169034ab0ace None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:56.676918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 315/629] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:56.682320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:56.682868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:56.682868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:56.706951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:56.708098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:56.715740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 315/630] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:56 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:56.738606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa305be-72bd-408a-b4fb-169034ab0ace None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:56.760361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa305be-72bd-408a-b4fb-169034ab0ace None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:56.767341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:56.768071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:56.768349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:56.768622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:56.781858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:56.788569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:31:56.789648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 316/631] 10.222.0.18 () {56 vars in 1141 bytes} [Mon Feb 28 18:31:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:56.795657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:56.804450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342288-1cfa-4e57-a649-4017ef171709 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:56.810012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:56.810736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:56.811024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:56.811304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:56.812018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:56.812316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:56.837542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:56.846950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 316/632] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:31:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:56.853241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:56.869639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1493d-b3a6-4461-a1b6-59b8a5c74e62 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:56.876299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:56.877000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:56.877280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:56.877552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:56.889609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:56.915093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:56.934007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:56.935042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 317/633] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:56.944211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:56.959863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51691f-c5ab-40f1-a58c-b6f6f07cae58 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:56.967994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:56.968583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:56.968868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:56.969144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:56.970190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:56.970483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:56.995592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.009887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 317/634] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:57.016147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.030728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880790e-e908-48ee-80b5-779bae364e9c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.036809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.037530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.037809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.038082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.051182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.076877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.095828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:31:57.096899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 318/635] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:31:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:57.106017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.122185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f6d22-63f3-4d01-bd94-f416123474d7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.128041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.128640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.128929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.129209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.130002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:57.130307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.155965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.185818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 318/636] 10.222.0.18 () {56 vars in 1170 bytes} [Mon Feb 28 18:31:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:57.191636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.202135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970276-fcc1-43c3-b82f-54aceade970b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.207432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363749-020c-4672-840b-964d3465d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.208125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363749-020c-4672-840b-964d3465d808 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.208403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363749-020c-4672-840b-964d3465d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.208674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363749-020c-4672-840b-964d3465d808 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.222637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363749-020c-4672-840b-964d3465d808 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.248981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65363749-020c-4672-840b-964d3465d808 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.271680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-65363749-020c-4672-840b-964d3465d808 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:57.273478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 319/637] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:57.282444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.296666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10fb1-d27f-4690-b70b-3fe691860124 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.301925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.302521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.302862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.303144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.303831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:57.304127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.329536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.342808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 319/638] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:57.349169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363749-020c-4672-840b-964d3465d808 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.361933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363749-020c-4672-840b-964d3465d808 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.367169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.367871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.368349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.368632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.378989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.404791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.419386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:31:57.420632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 320/639] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:57.426974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.442863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff984d-466f-4f1e-9443-d254f3173b48 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.451426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.452015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.452307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.452578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.453328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:57.453628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.479349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20083-f13b-4edd-b3ab-b664ad8a6f06 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.493442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 320/640] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:57.502758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:57.516179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c578295-c497-4ad6-9fb4-86a27404f6af admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:57.521513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a775-36d5-4da5-bf30-ccd53594d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:57.522645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a775-36d5-4da5-bf30-ccd53594d2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:57.523113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a775-36d5-4da5-bf30-ccd53594d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:57.523619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a775-36d5-4da5-bf30-ccd53594d2aa admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/8f45fc4f68f64c9a834fe0ccae08350a/roles/9f954624047f48eba9c2b6b8be46d57e` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:57.527289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a775-36d5-4da5-bf30-ccd53594d2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=8f45fc4f68f64c9a834fe0ccae08350a, role_id=9f954624047f48eba9c2b6b8be46d57e)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:57.557177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a775-36d5-4da5-bf30-ccd53594d2aa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:57.575084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 321/641] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:31:57 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/8f45fc4f68f64c9a834fe0ccae08350a/roles/9f954624047f48eba9c2b6b8be46d57e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:31:59.528556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79ae3-f8d4-4b12-985e-d363f91b0e23 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.529337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79ae3-f8d4-4b12-985e-d363f91b0e23 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.529337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79ae3-f8d4-4b12-985e-d363f91b0e23 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.530863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 321/642] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:31:59.537041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.537740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.537910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.563841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:31:59.564992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:31:59.631512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 322/643] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:31:59 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:31:59.661101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e79ae3-f8d4-4b12-985e-d363f91b0e23 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:59.674094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e79ae3-f8d4-4b12-985e-d363f91b0e23 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:59.679541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:59.680285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.680561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.680831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.692785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:31:59.699453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 18:31:59.700517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 322/644] 10.222.0.18 () {56 vars in 1141 bytes} [Mon Feb 28 18:31:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:59.707289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:59.721536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58776aa8-b639-4aa2-a8af-e8a601351320 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:59.729393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:59.730306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.730778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.731209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.732317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:59.732697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:59.757963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:59.768276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 323/645] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:31:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:31:59.777447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:59.794198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daa6a2-bfd0-400d-9e1d-b3fc66a79ea4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:59.799127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:59.799845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.800131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.800409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.811945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:59.837238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:59.856008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:31:59.857221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 323/646] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:31:59.865560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:59.875649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7744180-d396-4c48-827b-91bb799c7325 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:59.880407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:59.880993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.881279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.881561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.882255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:31:59.882584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:59.907969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:31:59.923210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 324/647] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:31:59.931385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:31:59.941765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91ef21-65f8-4cb5-a6fc-d9439b4a69ae admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:31:59.946741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:31:59.947474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:31:59.947758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:31:59.948036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:31:59.961493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:31:59.987719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.006073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 18:32:00.007159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:31:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:32:00.017059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.031563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae3e83-6755-4a8e-a5e9-7d0a0a411eff admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.037302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.037899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.038185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.038461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.039329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:00.039628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.065201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.102174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 325/649] 10.222.0.18 () {56 vars in 1170 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:00.111201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.125561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584db1-80e2-49fa-adb9-01929c1493c1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.131282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.131854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.132136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.132406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.141722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.167348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.176375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 325/650] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:32:00.182014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.194938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a345-0ef0-4524-9953-7326968fb67f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.199382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.200101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.200387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.200935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.221998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.251317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.268999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:00.270169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 326/651] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:00.276316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.285939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163fbe-28cd-4088-aac3-070e61c10f8f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.291905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.292490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.292796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.293095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.293852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:00.294147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.325177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.339382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 326/652] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:00.348968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.359057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40d29a-210b-412d-a60c-5ac472a7894b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.363847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.364552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.364837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.365111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.375429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.401193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.415555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:32:00.416606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 327/653] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:00.423476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.439522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a952-2320-4cba-ac6c-09d288cb6dae admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.448504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.449428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.449896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.450349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.451303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:00.451600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.477102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ce1a2-119b-4e71-9e90-bc3b03e18611 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.492528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 327/654] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:00.502447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:00.516125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c71d4-16a3-49be-b1b1-6040359942f0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:00.521259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:00.521861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:00.522154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:00.522430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:00.523268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] RBAC: Adding query filter params (role.id=9f954624047f48eba9c2b6b8be46d57e, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=8f45fc4f68f64c9a834fe0ccae08350a) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:00.523577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:00.548974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc51c7-777c-4f75-bc30-9bf0f8fbe04b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:00.555452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 328/655] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:32:00 2022] GET /identity/v3/role_assignments?user.id=8f45fc4f68f64c9a834fe0ccae08350a&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=9f954624047f48eba9c2b6b8be46d57e => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:02.550887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cc9ba-9c01-4910-95d1-46fd8f7e9b38 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:02.551710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cc9ba-9c01-4910-95d1-46fd8f7e9b38 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:02.551710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cc9ba-9c01-4910-95d1-46fd8f7e9b38 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:02.554357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 328/656] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:02.562881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:02.563588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:02.563794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:02.591214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:02.592366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:02.600223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 329/657] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:02 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:02.621825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cc9ba-9c01-4910-95d1-46fd8f7e9b38 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:02.636892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cc9ba-9c01-4910-95d1-46fd8f7e9b38 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:02.642716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:02.643419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:02.643698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:02.643978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] PATH_INFO: `/v3/services/image` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:02.644604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:02.670495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:02.681699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 18:32:02.682789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 329/658] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Feb 28 18:32:02 2022] GET /identity/v3/services/image => generated 86 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:02.689193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:02.702090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28fdb5-6e99-4235-bf75-2af26e2366ad None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:02.707742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:02.708338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:02.708624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:02.708901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:02.709576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] RBAC: Adding query filter params (name=image) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:02.709873 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:02.748574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb4ad7-51e4-45bd-8d22-814a9327feeb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:02.758501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 330/659] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:02.766220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:02.777166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb6925-1286-4daa-ac13-c642ec349b4f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:02.784657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:02.785276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:02.785570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:02.785845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:02.786575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:02.786907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:02.812880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87101e8c-e8c0-450e-9da2-d0cc5c21d2e8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:02.818183 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 330/660] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:04.773371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554025-3f43-4d1e-bb55-93f53ad629fd None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:04.774235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554025-3f43-4d1e-bb55-93f53ad629fd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:04.774235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f554025-3f43-4d1e-bb55-93f53ad629fd None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:04.777032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 331/661] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:04.785946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca2e5-3826-43d2-b538-6bb883d20633 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:04.786680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca2e5-3826-43d2-b538-6bb883d20633 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:04.786933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ca2e5-3826-43d2-b538-6bb883d20633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:04.813874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-004ca2e5-3826-43d2-b538-6bb883d20633 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:04.815032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-004ca2e5-3826-43d2-b538-6bb883d20633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:04.822715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 331/662] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:04 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:04.857807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554025-3f43-4d1e-bb55-93f53ad629fd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:04.872616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f554025-3f43-4d1e-bb55-93f53ad629fd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:04.878116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ca57-5048-47d6-b4dc-3dae4baf4162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:04.878751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ca57-5048-47d6-b4dc-3dae4baf4162 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:04.879039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ca57-5048-47d6-b4dc-3dae4baf4162 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:04.879320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ca57-5048-47d6-b4dc-3dae4baf4162 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:04.879972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787ca57-5048-47d6-b4dc-3dae4baf4162 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:04.905388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787ca57-5048-47d6-b4dc-3dae4baf4162 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:04.921648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 332/663] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:32:04 2022] POST /identity/v3/services => generated 242 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:06.958450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c629a-5b25-44c4-9b2f-12bf045bb041 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:06.959350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c629a-5b25-44c4-9b2f-12bf045bb041 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:06.959350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c629a-5b25-44c4-9b2f-12bf045bb041 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:06.962048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 332/664] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:06.968402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:06.969501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:06.969665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:06.997991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:06.999148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:07.018465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 333/665] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:06 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:07.051964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c629a-5b25-44c4-9b2f-12bf045bb041 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:07.066609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c629a-5b25-44c4-9b2f-12bf045bb041 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:07.073303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:07.074194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:07.074709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:07.075134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:07.076024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:07.101538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:07.112595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 18:32:07.113671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 333/666] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Feb 28 18:32:07 2022] GET /identity/v3/services/image => generated 86 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:07.123466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:07.141715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdc962-3646-4879-b13c-f50d93dba05a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:07.147665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:07.148259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:07.148542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:07.148845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:07.149521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:07.149820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:07.176026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:07.180844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 334/667] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:07.186950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:07.196775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03825aec-2266-4d0e-a9f3-0e0c9f87b849 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:07.201939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:07.202520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:07.202837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:07.203111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:07.203784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:07.204081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:07.229798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:07.235171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 334/668] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:07.244395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:07.260106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc9c5-17a9-4128-a9a7-1504415028c2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:07.267557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:07.268143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:07.268423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:07.268695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:07.269440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] RBAC: Adding query filter params (interface=public, service_id=d46c8115b1fd4b55adb0eccc3ad85254, region_id=RegionOne) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:07.269735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:07.295283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594cbb-8285-4716-a594-dc005fbba762 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:07.301213 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 335/669] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:32:07 2022] GET /identity/v3/endpoints?service_id=d46c8115b1fd4b55adb0eccc3ad85254&interface=public®ion_id=RegionOne => generated 194 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:07.307395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:07.318501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1900815-4cf7-41d2-959c-faec80786b98 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:07.324149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f629325-a8c2-47b4-b42e-e4b3fe70bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:07.324727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629325-a8c2-47b4-b42e-e4b3fe70bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:07.325038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629325-a8c2-47b4-b42e-e4b3fe70bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:07.325317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629325-a8c2-47b4-b42e-e4b3fe70bbfa admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:07.325952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629325-a8c2-47b4-b42e-e4b3fe70bbfa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:07.351496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629325-a8c2-47b4-b42e-e4b3fe70bbfa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:07.357550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 335/670] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:32:07 2022] GET /identity/v3/services => generated 1022 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:32:09.339451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accbb32-25ff-47a0-a878-4c6c7751fdcf None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:09.340265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accbb32-25ff-47a0-a878-4c6c7751fdcf None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:09.340378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accbb32-25ff-47a0-a878-4c6c7751fdcf None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:09.343205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 336/671] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:09.348808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:09.349247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:09.349345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:09.373594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:09.374751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:09.388002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 336/672] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:09 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:09.410474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accbb32-25ff-47a0-a878-4c6c7751fdcf None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:09.427857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accbb32-25ff-47a0-a878-4c6c7751fdcf None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:09.433701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:09.434408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:09.434779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:09.435111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:09.435681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:09.460814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:09.472422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 18:32:09.473478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 337/673] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Feb 28 18:32:09 2022] GET /identity/v3/services/image => generated 86 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:09.482107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:09.491501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ace404-475f-4ed3-9f1d-9a680c0efc47 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:09.497694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:09.498293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:09.498593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:09.498902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:09.499583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:09.499877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:09.525433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:09.530893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 337/674] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:09.537162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:09.550713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16378062-b5af-41ff-b9b5-bff40edda020 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:09.555606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:09.556188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:09.556481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:09.556763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:09.557439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:09.557744 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:09.582871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018bb4d2-ff1c-40a1-b043-58da1ba535a9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:09.587757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 338/675] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:09.593121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:09.603426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c0ef9-d09a-4aaf-83f6-298f619c9720 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:09.608619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dc8cd-2811-4cff-ad8e-8bb42737cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:09.609179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dc8cd-2811-4cff-ad8e-8bb42737cb18 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:09.609462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dc8cd-2811-4cff-ad8e-8bb42737cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:09.609741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dc8cd-2811-4cff-ad8e-8bb42737cb18 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:09.610432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dc8cd-2811-4cff-ad8e-8bb42737cb18 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:09.635444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dc8cd-2811-4cff-ad8e-8bb42737cb18 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:09.656758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 338/676] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:32:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:11.662329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548a0f-ef21-4b2a-8967-42dc31cf8432 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:11.663209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548a0f-ef21-4b2a-8967-42dc31cf8432 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:11.663209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548a0f-ef21-4b2a-8967-42dc31cf8432 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:11.665921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 339/677] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:11.673641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:11.674069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:11.674226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:11.707334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:11.708459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:11.728002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 339/678] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:11 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:11.750058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548a0f-ef21-4b2a-8967-42dc31cf8432 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:11.765252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548a0f-ef21-4b2a-8967-42dc31cf8432 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:11.770657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9dc6f-0dac-4f59-afa7-5e107a517dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:11.771231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dc6f-0dac-4f59-afa7-5e107a517dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:11.771519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dc6f-0dac-4f59-afa7-5e107a517dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:11.771796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dc6f-0dac-4f59-afa7-5e107a517dd2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:11.781226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dc6f-0dac-4f59-afa7-5e107a517dd2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:11.806583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dc6f-0dac-4f59-afa7-5e107a517dd2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:11.816547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 340/679] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:32:11 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:32:11.823164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:11.837163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eee532-d57c-487d-93a2-c84b87695874 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:11.844457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961328b4-7621-425a-8c3a-1df54ee4a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:11.845181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961328b4-7621-425a-8c3a-1df54ee4a733 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:11.845460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961328b4-7621-425a-8c3a-1df54ee4a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:11.845766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961328b4-7621-425a-8c3a-1df54ee4a733 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:11.847039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961328b4-7621-425a-8c3a-1df54ee4a733 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:11.872414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961328b4-7621-425a-8c3a-1df54ee4a733 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:11.874008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 340/680] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:13.956626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2695666-9b20-4e38-a715-8e9a924c7f23 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:13.957214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2695666-9b20-4e38-a715-8e9a924c7f23 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:13.957214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2695666-9b20-4e38-a715-8e9a924c7f23 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:13.958848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 341/681] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:13.966588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:13.966981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:13.967167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:13.995460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:13.996566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:14.004022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 341/682] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:13 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:14.030646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2695666-9b20-4e38-a715-8e9a924c7f23 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:14.042676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2695666-9b20-4e38-a715-8e9a924c7f23 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:14.046993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:14.047777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:14.048064 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:14.048340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:14.059931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:14.085178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:14.102429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:14.103524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 342/683] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:14.112813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:14.122184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b384bad-16db-43e8-9235-dbce5a56d737 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:14.129453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:14.131065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:14.131356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:14.131705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:14.132397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:14.132695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:14.158308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76263e16-e593-4cd3-8f4a-0dd52666e21f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:14.172775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 342/684] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:32:14.178547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:14.188594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acabc-dfcb-459c-9e68-22f3b6a09501 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:14.192938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10f71-5d62-4da3-a71c-93a4f782a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:14.193520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10f71-5d62-4da3-a71c-93a4f782a984 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:14.193799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10f71-5d62-4da3-a71c-93a4f782a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:14.194073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10f71-5d62-4da3-a71c-93a4f782a984 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:14.194755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff10f71-5d62-4da3-a71c-93a4f782a984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:14.220655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff10f71-5d62-4da3-a71c-93a4f782a984 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:14.250369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 343/685] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:32:14 2022] POST /identity/v3/users => generated 248 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:16.410070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f144c-405f-4462-a8fe-e1ab6d42c745 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.410708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f144c-405f-4462-a8fe-e1ab6d42c745 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.410708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f144c-405f-4462-a8fe-e1ab6d42c745 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.412332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 343/686] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:16.418588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.420378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.420378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.448877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:16.450149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:16.459077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 344/687] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:16 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:16.484638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f144c-405f-4462-a8fe-e1ab6d42c745 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.501259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f144c-405f-4462-a8fe-e1ab6d42c745 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.505510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.506213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.506492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.506795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.518820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:32:16.525158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:32:16.526258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 344/688] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:16.532973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.547183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977cc27-8bbc-43df-b525-2c21e8b7b651 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.554936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.555549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.555838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.556131 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.557305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:16.557805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:16.583782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:16.592931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 345/689] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:16.602728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.619425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37307ed-673f-4ba5-a983-d795ec8b3c20 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.628867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.629966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.630432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.630922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.650748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:16.678084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:16.697066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:16.698138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 345/690] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:16.704384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.714828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3891e-6159-4ed2-82f2-ab51bb30d666 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.720759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.721349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.721635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.721916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.722614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:16.722938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:16.748225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:16.760979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 346/691] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:16.769504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.785211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06776c31-ad94-4948-ae7c-f1ed30841bbf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.792090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.793194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.793916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.794339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.806924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:16.833412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:16.852237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:32:16.853309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 346/692] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:16.859895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.875837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad59f-8ed1-405f-ac1c-5f40076089fc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.883759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.884706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.885183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.885651 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.887002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:16.887523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:16.913501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:16.944818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 347/693] 10.222.0.18 () {56 vars in 1158 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:16.953295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:16.965940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a1068-e2db-4a7a-ba7b-d49e0b91af0e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:16.971679 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:16.972250 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:16.972535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:16.972811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:16.981626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:17.006989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:17.016187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 347/694] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:32:16 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:32:17.023056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:17.039082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044fafe-6eb2-4c1d-94e5-d0e4c648258f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:17.046442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:17.047187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:17.047469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:17.047746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:17.060042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:17.085711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:17.103482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:17.104574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 348/695] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:17.110387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:17.119101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84530fca-b2bd-4fe9-b657-3090c5b4fe7b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:17.124977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:17.125554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:17.125839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:17.126112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:17.126830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:17.127126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:17.152157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:17.166579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 348/696] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:17.172736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:17.187211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be50b70-f671-43f8-83f6-e0b014f15b5d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:17.192272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:17.193072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:17.193361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:17.193638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:17.203313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:17.229137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:17.243843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:32:17.244980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 349/697] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:17.255344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:17.272287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb32180-dc6d-464c-8da5-acfa8e6c572d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:17.279719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:17.280308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:17.280589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:17.280864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:17.281612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:17.281907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:17.307609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa917f-c3bc-41fd-8b7f-586226388c94 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:17.322480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 349/698] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:17.332262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:17.346040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a5e63-8c1b-4c6e-b2ce-63c4d26635b5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:17.351351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:17.351933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:17.352212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:17.352485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:17.353273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=d60d7d7120b047c5b45fb922c8063048) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:17.353567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:17.379011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94063cba-16ec-4b2d-8aad-2505379ec2f8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:17.384764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 350/699] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:32:17 2022] GET /identity/v3/role_assignments?user.id=d60d7d7120b047c5b45fb922c8063048&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:19.344865 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39644a14-b962-427b-8297-36d15822e39f None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.345446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39644a14-b962-427b-8297-36d15822e39f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.345446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39644a14-b962-427b-8297-36d15822e39f None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.347136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 350/700] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:19.353318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.354060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.354373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.384728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:19.385861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:19.393952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 351/701] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:19 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:19.420446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39644a14-b962-427b-8297-36d15822e39f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.442809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39644a14-b962-427b-8297-36d15822e39f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.451530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.452642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.453093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.453540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.471263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:32:19.477448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:32:19.478570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 351/702] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:19.487412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.496561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a3a7e-273d-48c7-97fb-39f29cb41b8a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.502662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.503259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.503525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.503797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.504522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:19.504811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:19.531261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:19.540458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 352/703] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:19.549342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.563807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a77e-1a09-4a12-b26f-72039650de8e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.568348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.569055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.569339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.569616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.582222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:19.608792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:19.627847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:19.628941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 352/704] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:19.635539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.651200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea6fdd-6894-4e0a-83f5-ae37db134392 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.657510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.658100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.658388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.658708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.659403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:19.659702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:19.685404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:19.698624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 353/705] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:19.704286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.713586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f9405-c4ad-4617-9943-0dca956a0aff admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.718108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.719161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.719447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.719725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.732726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:19.758149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:19.775725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:32:19.776777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 353/706] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:19.783086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.796685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5afbd-fb9a-40ae-be9b-12c6cedf1b2c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.801613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.802211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.802501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.802819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.803626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:19.803938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:19.830229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:19.860840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 354/707] 10.222.0.18 () {56 vars in 1158 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:19.866752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.877170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58119e-1ae0-433b-a15c-0b6edef46a2d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.883220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.883921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.884201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.884470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.898617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:19.931576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:19.950217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:19.951350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 354/708] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:19.960213 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:19.976616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68def0e0-4c92-4455-aaec-0d1419eeecc5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:19.984167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:19.984687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:19.984966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:19.985239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:19.985924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:19.986223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:20.011710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:20.025604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 355/709] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:20.034618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:20.048241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd7ebc-f726-4fb0-94a6-bb79337e7cae admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:20.053564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:20.054277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:20.054548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:20.054863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:20.064576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:20.089674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:20.104017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:32:20.105104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 355/710] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:32:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:20.114621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:20.127227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5ea42-3f7b-414c-b937-3751cb55c0b4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:20.133009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:20.133585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:20.133866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:20.134140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:20.134988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:20.135282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:20.160735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb06fe-b130-47aa-a0df-350fb1fcfe21 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:20.174897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 356/711] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:20.181386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:20.192526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bdd18-cafb-4772-9c33-c9cc1493fd25 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:20.196884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b39fb-b114-4f41-b4a6-efc5185fb690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:20.197696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b39fb-b114-4f41-b4a6-efc5185fb690 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:20.197982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b39fb-b114-4f41-b4a6-efc5185fb690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:20.198262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b39fb-b114-4f41-b4a6-efc5185fb690 admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/d60d7d7120b047c5b45fb922c8063048/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:20.220213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b39fb-b114-4f41-b4a6-efc5185fb690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=d60d7d7120b047c5b45fb922c8063048, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:20.246221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b39fb-b114-4f41-b4a6-efc5185fb690 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:20.266293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 356/712] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:32:20 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/d60d7d7120b047c5b45fb922c8063048/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:32:22.209487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8aab-91ed-4b3f-9e09-a015f370f387 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.209940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8aab-91ed-4b3f-9e09-a015f370f387 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.209940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb8aab-91ed-4b3f-9e09-a015f370f387 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.211645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 357/713] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:22.217707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.218457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.218658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.247849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:22.249656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:22.321462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 357/714] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:22 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:22.346067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb8aab-91ed-4b3f-9e09-a015f370f387 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.365948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb8aab-91ed-4b3f-9e09-a015f370f387 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.373265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.373990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.374274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.374583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.387293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:32:22.393578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:32:22.394729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 358/715] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:22.400755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.409637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fb6f-9076-4d10-84b3-10706d4ad3ef None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.414595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.415222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.415515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.415789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.416506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:22.416805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.442599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.451232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 358/716] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:22.457317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.470949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b52bdc-4ae9-4d0f-a91c-4c6b3d13e552 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.476002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.476704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.476991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.477268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.489108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.514547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.534150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:22.535261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 359/717] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:22.544602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.560133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf555384-c65c-4824-9025-1307ca6ca943 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.566590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.567202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.567479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.567751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.568433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:22.568723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.594288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.613597 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:22.619739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.630541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b91a-c46f-410f-b25a-22a0b83b15f3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.636464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.637214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.637717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.638004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.651460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.676925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.694697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:32:22.695760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 360/719] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:22.703249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.712599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86812d6a-7aea-4a23-9164-42dfe276adef admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.717428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.718004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.718602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.718909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.719704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:22.720009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.745409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.774871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 360/720] 10.222.0.18 () {56 vars in 1158 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:32:22.784438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.797932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4227205-2e28-40a6-afd5-462a80fe4e0c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.803324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.803948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.804235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.804516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.812803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.838384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.847082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 361/721] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:32:22.855543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.865248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83e416-f0c2-4f32-baab-c934e0076888 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.870641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.871352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.871916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.871916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.883974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.909525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.927489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:22.928571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 361/722] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:22.934886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:22.949157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ebd67-cf24-4da4-a83f-efd7ab309036 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:22.953936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:22.954512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:22.954826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:22.955101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:22.955786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:22.956078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:22.982488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:22.998321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 362/723] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:23.004455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:23.016802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a452aa-c59e-469a-b6ba-8401c064ca45 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:23.022531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:23.023276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:23.023576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:23.023917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:23.035003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:23.060318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:23.074607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:32:23.075688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 362/724] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:32:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:32:23.084877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:23.097771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450b8e-68a0-468c-8f28-5c977da4cb1a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:23.103171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:23.103780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:23.104060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:23.104335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:23.105079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:23.105372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:23.131462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662000-83a2-4227-91c6-01157bf79fc9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:23.145436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 363/725] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:32:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:23.152042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:23.168215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e87f-9661-4be0-95d3-4eb77208918b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:23.176791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:23.177704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:23.178119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:23.178527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:23.179829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=d60d7d7120b047c5b45fb922c8063048) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:23.180315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:23.207164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5dfd8-a8de-45d4-b9f1-d09dacdc33a7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:23.213156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 363/726] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:32:23 2022] GET /identity/v3/role_assignments?user.id=d60d7d7120b047c5b45fb922c8063048&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:25.192196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31053425-c2b2-4154-93d3-85e3c550c853 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:25.192733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31053425-c2b2-4154-93d3-85e3c550c853 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:25.192733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31053425-c2b2-4154-93d3-85e3c550c853 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:25.194408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 364/727] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:25.199870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f34531-8217-4954-9510-d04cba24f664 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:25.200274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f34531-8217-4954-9510-d04cba24f664 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:25.200520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f34531-8217-4954-9510-d04cba24f664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:25.231584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-06f34531-8217-4954-9510-d04cba24f664 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:25.232743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-06f34531-8217-4954-9510-d04cba24f664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:25.242061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 364/728] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:25 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:25.264780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31053425-c2b2-4154-93d3-85e3c550c853 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:25.285831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31053425-c2b2-4154-93d3-85e3c550c853 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:25.293892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:25.295093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:25.295598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:25.296074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:25.297168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:25.329890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:25.341786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 18:32:25.342915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 365/729] 10.222.0.18 () {56 vars in 1150 bytes} [Mon Feb 28 18:32:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:25.353229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f34531-8217-4954-9510-d04cba24f664 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:25.367530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f34531-8217-4954-9510-d04cba24f664 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:25.374346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:25.374970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:25.375258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:25.375531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:25.376208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:25.376503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:25.401647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56379-1f1f-4491-8f34-972f0919f868 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:25.408976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 365/730] 10.222.0.18 () {56 vars in 1145 bytes} [Mon Feb 28 18:32:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:25.415224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:25.430254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61b4fa-90a1-4c4a-9b58-cf71dfbcd286 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:25.437582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:25.438163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:25.438447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:25.438752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:25.439430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:25.439729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:25.465320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8938e-d686-4c60-a596-90afbd524cf6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:25.470375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 366/731] 10.222.0.18 () {56 vars in 1145 bytes} [Mon Feb 28 18:32:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:27.455776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3866d-dc07-48b8-a585-6b121cad9be3 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:27.456664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3866d-dc07-48b8-a585-6b121cad9be3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:27.456664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3866d-dc07-48b8-a585-6b121cad9be3 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:27.459487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 366/732] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:27.465749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2eab1-5fec-42ee-b96e-d5217ade99b6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:27.466470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2eab1-5fec-42ee-b96e-d5217ade99b6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:27.466799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2eab1-5fec-42ee-b96e-d5217ade99b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:27.497245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-16b2eab1-5fec-42ee-b96e-d5217ade99b6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:27.498367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-16b2eab1-5fec-42ee-b96e-d5217ade99b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:27.507051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 367/733] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:27 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:27.529407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3866d-dc07-48b8-a585-6b121cad9be3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:27.548484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3866d-dc07-48b8-a585-6b121cad9be3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:27.554002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79e811-5e8f-446a-a93d-30d77aa486c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:27.554577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e811-5e8f-446a-a93d-30d77aa486c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:27.554885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e811-5e8f-446a-a93d-30d77aa486c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:27.555161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79e811-5e8f-446a-a93d-30d77aa486c5 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:27.555824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e811-5e8f-446a-a93d-30d77aa486c5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:27.581678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79e811-5e8f-446a-a93d-30d77aa486c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:27.598139 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 367/734] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:32:27 2022] POST /identity/v3/services => generated 251 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:29.567514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000ae8-dff6-4837-ad44-dcb72cdba921 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.568128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000ae8-dff6-4837-ad44-dcb72cdba921 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.568128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf000ae8-dff6-4837-ad44-dcb72cdba921 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.569784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 368/735] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:29.575990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.576729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.576875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.611620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:29.612759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:29.633125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 368/736] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:29 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:29.656599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000ae8-dff6-4837-ad44-dcb72cdba921 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:29.671667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf000ae8-dff6-4837-ad44-dcb72cdba921 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:29.676745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:29.677465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.677739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.678017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.678717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:29.704452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:29.715857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 18:32:29.716895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 369/737] 10.222.0.18 () {56 vars in 1150 bytes} [Mon Feb 28 18:32:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:29.723813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:29.735199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe2152-2d01-4b6d-b4a7-eec31096ee39 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:29.740598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:29.741182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.741467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.741742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.742421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:29.742749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:29.767975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:29.772759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 369/738] 10.222.0.18 () {56 vars in 1145 bytes} [Mon Feb 28 18:32:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:29.781478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:29.795879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32772d-5feb-4f82-96ed-4d1b8ab98b0d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:29.801279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:29.801871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.802152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.802429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.803137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:29.803442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:29.828671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:29.834094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 370/739] 10.222.0.18 () {56 vars in 1145 bytes} [Mon Feb 28 18:32:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:29.841179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:29.857326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06221f9-5d71-4094-9a49-38bcc7aed659 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:29.865446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:29.866364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.866881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.867338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.868533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] RBAC: Adding query filter params (interface=public, service_id=9836b5bd787a408a85b500b03f91c4df, region_id=RegionOne) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:29.869020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:29.898456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42ea8c-9a18-49be-a9d9-5375287948ef admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:29.904849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 370/740] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:32:29 2022] GET /identity/v3/endpoints?service_id=9836b5bd787a408a85b500b03f91c4df&interface=public®ion_id=RegionOne => generated 194 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:29.911117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:29.926913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7006c-b29a-47cf-a38a-6a3b3b94c3da admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:29.935288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8aed3-46e5-4fd1-86b8-8ed307397340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:29.935864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8aed3-46e5-4fd1-86b8-8ed307397340 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:29.936146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8aed3-46e5-4fd1-86b8-8ed307397340 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:29.936418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8aed3-46e5-4fd1-86b8-8ed307397340 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:29.937062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8aed3-46e5-4fd1-86b8-8ed307397340 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:29.962191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8aed3-46e5-4fd1-86b8-8ed307397340 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:29.968779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 371/741] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:32:29 2022] GET /identity/v3/services => generated 1261 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:32:31.964712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c6bca-1dbf-4868-9d94-0566eb10d52e None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:31.965625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c6bca-1dbf-4868-9d94-0566eb10d52e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:31.965776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c6bca-1dbf-4868-9d94-0566eb10d52e None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:31.968783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 371/742] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:31.976400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96694973-ffbc-4697-814f-834f7b348068 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:31.976831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96694973-ffbc-4697-814f-834f7b348068 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:31.976938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96694973-ffbc-4697-814f-834f7b348068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:32.000827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-96694973-ffbc-4697-814f-834f7b348068 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:32.001949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-96694973-ffbc-4697-814f-834f7b348068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:32.009167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 372/743] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:31 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:32:32.032246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c6bca-1dbf-4868-9d94-0566eb10d52e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:32.046096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c6bca-1dbf-4868-9d94-0566eb10d52e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:32.050393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:32.051155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:32.051435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:32.051711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:32.052334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:32.078164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:32.089704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 18:32:32.091071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 372/744] 10.222.0.18 () {56 vars in 1150 bytes} [Mon Feb 28 18:32:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:32.097865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96694973-ffbc-4697-814f-834f7b348068 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:32.112465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96694973-ffbc-4697-814f-834f7b348068 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:32.120558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:32.121497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:32.122106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:32.122416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:32.123117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:32.123415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:32.148641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:32.153938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 373/745] 10.222.0.18 () {56 vars in 1145 bytes} [Mon Feb 28 18:32:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:32.162933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:32.173832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356811-2a95-48df-bc23-ba2e291de96d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:32.179112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:32.179687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:32.179969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:32.180242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:32.180902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:32.181196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:32.206387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bae825-24e8-4507-b933-917bc2949921 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:32.211596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 373/746] 10.222.0.18 () {56 vars in 1145 bytes} [Mon Feb 28 18:32:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:32.217533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:32.227700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a2e4-31aa-42f9-a301-32c209945798 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:32.234315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf2ad-2e07-4ec9-909a-cc1db1747538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:32.234916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf2ad-2e07-4ec9-909a-cc1db1747538 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:32.235200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf2ad-2e07-4ec9-909a-cc1db1747538 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:32.235479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf2ad-2e07-4ec9-909a-cc1db1747538 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:32.236163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf2ad-2e07-4ec9-909a-cc1db1747538 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:32.261321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf2ad-2e07-4ec9-909a-cc1db1747538 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:32.284073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 374/747] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:32:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:32:34.229318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507fa81-7411-4af0-945b-d164d3b491f0 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:34.229825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507fa81-7411-4af0-945b-d164d3b491f0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:34.229915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507fa81-7411-4af0-945b-d164d3b491f0 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:34.232324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 374/748] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:34.238662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:34.239068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:34.239318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:34.271410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:34.272558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:34.292100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 375/749] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:34 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:34.320692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507fa81-7411-4af0-945b-d164d3b491f0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:34.334540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507fa81-7411-4af0-945b-d164d3b491f0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:34.341599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:34.342337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:34.342960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:34.343230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:34.343854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:34.369396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:34.381407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Feb 28 18:32:34.382484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 375/750] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:34 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:34.391756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:34.405251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb31464-48f3-4183-a6a6-937063e622cd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:34.411220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:34.411810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:34.412094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:34.412372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:34.413049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:34.413348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:34.438568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54568b-118c-4342-af79-8439a2d019c7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:34.443683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 376/751] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:34 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:34.454491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:34.470095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0b174-615b-457f-a391-08099f3c8d2c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:34.474693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:34.475301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:34.475581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:34.475854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:34.476517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:34.476806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:34.502526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3b1f3-849f-4a51-a269-717260c57a65 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:34.507458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 376/752] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:34 2022] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:36.491811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f2538-1840-4f12-bedf-f55c1db39ccb None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:36.492602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f2538-1840-4f12-bedf-f55c1db39ccb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:36.492602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f2538-1840-4f12-bedf-f55c1db39ccb None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:36.495222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 377/753] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:36.500857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e3a6-e721-4fc4-84ea-7d0deb514f99 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:36.501359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e3a6-e721-4fc4-84ea-7d0deb514f99 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:36.501359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30e3a6-e721-4fc4-84ea-7d0deb514f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:36.524851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ef30e3a6-e721-4fc4-84ea-7d0deb514f99 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:36.526008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ef30e3a6-e721-4fc4-84ea-7d0deb514f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:36.533965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 377/754] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:36 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:36.556476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f2538-1840-4f12-bedf-f55c1db39ccb None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:36.572964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f2538-1840-4f12-bedf-f55c1db39ccb None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:36.580149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffe8c3-7aee-4ed9-b38a-84d02dabee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:36.581128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffe8c3-7aee-4ed9-b38a-84d02dabee8f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:36.581594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffe8c3-7aee-4ed9-b38a-84d02dabee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:36.582062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffe8c3-7aee-4ed9-b38a-84d02dabee8f admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:36.583200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffe8c3-7aee-4ed9-b38a-84d02dabee8f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:36.612123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffe8c3-7aee-4ed9-b38a-84d02dabee8f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:36.633216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 378/755] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:32:36 2022] POST /identity/v3/services => generated 251 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:38.624199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950549-c09c-49a4-b88f-8581dc548a49 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.625030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950549-c09c-49a4-b88f-8581dc548a49 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.625137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950549-c09c-49a4-b88f-8581dc548a49 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.627936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 378/756] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:38.633886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.634600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.634872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.659352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:38.660485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:38.678963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 379/757] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:38 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:38.710079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950549-c09c-49a4-b88f-8581dc548a49 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:38.724737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950549-c09c-49a4-b88f-8581dc548a49 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:38.730339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:38.731099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.731424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.731673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.732326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:38.757322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:38.768068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Feb 28 18:32:38.769121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 379/758] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:38 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:38.777693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:38.786317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453137b4-f3be-4ff1-b003-56a4b98537bf None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:38.791523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:38.792102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.792391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.792669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.793340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:38.793640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:38.819106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:38.824206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 380/759] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:38 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:32:38.833191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:38.846019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d350f-0573-42d5-bdd6-91a9d3c5ee3c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:38.851651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:38.852225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.852503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.852771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.853432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:38.853723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:38.878774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:38.883580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 380/760] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:38 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:38.889618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:38.904376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea370108-3260-4190-a908-ad554f9cfca9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:38.910062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:38.910662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.910950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.911228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.911971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] RBAC: Adding query filter params (interface=public, service_id=f324ac3732f14f3db4009f608e1393da, region_id=RegionOne) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:38.912273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:38.937830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47075b-5695-4be0-a32e-3be144fec65b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:38.943553 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 381/761] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:32:38 2022] GET /identity/v3/endpoints?service_id=f324ac3732f14f3db4009f608e1393da&interface=public®ion_id=RegionOne => generated 194 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:38.952340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:38.967762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8c768-c2ff-4a75-a9f6-a34ec69c6469 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:38.973044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5470-9675-429d-a380-2cdbe6d04af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:38.973600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5470-9675-429d-a380-2cdbe6d04af2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:38.973881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5470-9675-429d-a380-2cdbe6d04af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:38.974155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5470-9675-429d-a380-2cdbe6d04af2 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:38.974843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5470-9675-429d-a380-2cdbe6d04af2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:39.000209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5470-9675-429d-a380-2cdbe6d04af2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:39.006419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 381/762] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:32:38 2022] GET /identity/v3/services => generated 1500 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:32:40.933149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3f6a-3c8c-4b77-afee-cadc4b6b205c None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:40.933702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3f6a-3c8c-4b77-afee-cadc4b6b205c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:40.933702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3f6a-3c8c-4b77-afee-cadc4b6b205c None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:40.935528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 382/763] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:40.941706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:40.942387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:40.942603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:40.970231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:40.971381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:40.980527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 382/764] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:40 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:41.014783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3f6a-3c8c-4b77-afee-cadc4b6b205c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:41.028198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3f6a-3c8c-4b77-afee-cadc4b6b205c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:41.032545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:41.033255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:41.033542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:41.033821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:41.034444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:41.059788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:41.070412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Feb 28 18:32:41.071481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 383/765] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:41 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:41.077844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:41.091634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43c12-0afd-4df1-b567-7fb3c908a58b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:41.098114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:41.098750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:41.099035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:41.099308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:41.099982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:41.100275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:41.125469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:41.130485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 383/766] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:41 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:41.139101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:41.154216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec7f8-bdab-4f10-aade-4b3772ac08e5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:41.159635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:41.160206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:41.160486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:41.160763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:41.161426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:41.161721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:41.186936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04a6a-37f0-4bf3-8f1c-4e88dfae35fe admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:41.191772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 384/767] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:41 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:41.197226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:41.206464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7e8b-600b-402b-b824-020d094dedc2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:41.211965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3cc90-c8d5-4c81-af1c-19d54f6278f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:41.212537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3cc90-c8d5-4c81-af1c-19d54f6278f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:41.212823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3cc90-c8d5-4c81-af1c-19d54f6278f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:41.213099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3cc90-c8d5-4c81-af1c-19d54f6278f4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:41.213856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3cc90-c8d5-4c81-af1c-19d54f6278f4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:41.239230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3cc90-c8d5-4c81-af1c-19d54f6278f4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:41.264054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 384/768] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:32:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:43.224473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0af506-cc6f-4e7f-8936-ca832859ed11 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:43.225240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0af506-cc6f-4e7f-8936-ca832859ed11 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:43.225328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0af506-cc6f-4e7f-8936-ca832859ed11 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:43.227999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 385/769] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:43.234831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:43.235282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:43.235383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:43.257785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:43.258923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:43.275931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 385/770] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:43 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:32:43.298272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0af506-cc6f-4e7f-8936-ca832859ed11 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:43.311844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0af506-cc6f-4e7f-8936-ca832859ed11 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:43.317357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:43.318088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:43.318379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:43.318680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:43.319315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:43.345215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:43.356435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 18:32:43.357492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 386/771] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:43.363940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:43.376331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f90494-5990-4dc8-8af4-957fe4273368 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:43.382144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:43.382761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:43.383041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:43.383314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:43.383983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:43.384272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:43.411091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ee13-8fb8-4582-a54e-7cd29fc428f7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:43.416555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 386/772] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:43.425917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:43.443317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dbe41-37ae-4d13-8097-b4103b5737d5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:43.448863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:43.449510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:43.449990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:43.450117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:43.450762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:43.451063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:43.476883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09049da9-5ebc-4686-92f0-9a66828397af admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:43.482299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 387/773] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:45.441544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3147d87-88f5-4fd5-8a76-e201becee656 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:45.442470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3147d87-88f5-4fd5-8a76-e201becee656 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:45.442771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3147d87-88f5-4fd5-8a76-e201becee656 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:45.445486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 387/774] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:45.452828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e26010-6e8f-4244-9cb3-bca11ddaac47 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:45.453293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e26010-6e8f-4244-9cb3-bca11ddaac47 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:45.453388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e26010-6e8f-4244-9cb3-bca11ddaac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:45.487541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-37e26010-6e8f-4244-9cb3-bca11ddaac47 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:45.488589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-37e26010-6e8f-4244-9cb3-bca11ddaac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:45.497151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 388/775] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:45 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:45.524956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3147d87-88f5-4fd5-8a76-e201becee656 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:45.539346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3147d87-88f5-4fd5-8a76-e201becee656 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:45.545281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0a432-55a9-443d-8c22-0fb67e950406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:45.546209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0a432-55a9-443d-8c22-0fb67e950406 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:45.546788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0a432-55a9-443d-8c22-0fb67e950406 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:45.547251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0a432-55a9-443d-8c22-0fb67e950406 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:45.548304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0a432-55a9-443d-8c22-0fb67e950406 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:45.578352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0a432-55a9-443d-8c22-0fb67e950406 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:45.598815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 388/776] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:32:45 2022] POST /identity/v3/services => generated 251 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:47.593023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0ef1-95a8-4227-9053-f624fe26a838 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.593582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0ef1-95a8-4227-9053-f624fe26a838 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.593582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0ef1-95a8-4227-9053-f624fe26a838 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.595249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 389/777] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:47.601081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.601536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.601631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.624934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:47.626082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:47.643633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 389/778] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:47 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:47.665348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0ef1-95a8-4227-9053-f624fe26a838 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:47.677492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0ef1-95a8-4227-9053-f624fe26a838 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:47.681925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:47.682668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.682974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.683243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.683865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:47.709640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:47.721382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 18:32:47.722497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 390/779] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:47.728510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:47.737385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcc586-b187-4f9e-847d-76c57486f94c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:47.741684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:47.742271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.742578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.742864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.743534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:47.743831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:47.768965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:47.774463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 390/780] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:47.780666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:47.790446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b341db-f9cc-4fa9-ad0e-882d76462394 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:47.795453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:47.796138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.796493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.796846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.797597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:47.797967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:47.823628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:47.829353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 391/781] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:47.835511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:47.846514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be50717-a549-4afc-a660-de0f27086a28 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:47.852116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:47.852694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.852974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.853255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.853999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] RBAC: Adding query filter params (interface=public, service_id=7b944478c0ff4a6894ac8c77ee075398, region_id=RegionOne) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:47.854296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:47.880017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72170052-208b-44c3-864f-983a60b7990d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:47.885844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 391/782] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:32:47 2022] GET /identity/v3/endpoints?service_id=7b944478c0ff4a6894ac8c77ee075398&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:47.895415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:47.908587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c46a7-b78e-4aaa-9943-63ada55edf43 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:47.914882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fe02c-9465-4ccc-b4cb-9b53da4d17a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:47.915466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe02c-9465-4ccc-b4cb-9b53da4d17a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:47.915755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe02c-9465-4ccc-b4cb-9b53da4d17a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:47.916035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe02c-9465-4ccc-b4cb-9b53da4d17a9 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:47.916695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fe02c-9465-4ccc-b4cb-9b53da4d17a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:47.942120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fe02c-9465-4ccc-b4cb-9b53da4d17a9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:47.948879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 392/783] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:32:47 2022] GET /identity/v3/services => generated 1739 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:32:50.004347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66500f2-9f1c-4444-b846-b4a24cd54338 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:50.005185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66500f2-9f1c-4444-b846-b4a24cd54338 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:50.005185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66500f2-9f1c-4444-b846-b4a24cd54338 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:50.007861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 392/784] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:50.013964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88714311-340c-440f-ace0-d7b317461fed None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:50.014424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88714311-340c-440f-ace0-d7b317461fed None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:50.014520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88714311-340c-440f-ace0-d7b317461fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:50.043494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-88714311-340c-440f-ace0-d7b317461fed None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:50.044635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-88714311-340c-440f-ace0-d7b317461fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:50.055908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 393/785] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:50 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:50.079453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66500f2-9f1c-4444-b846-b4a24cd54338 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:50.094403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66500f2-9f1c-4444-b846-b4a24cd54338 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:50.099543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:50.100254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:50.100541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:50.100818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:50.101427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:50.126951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:50.137789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 18:32:50.138872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 393/786] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:50.144913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88714311-340c-440f-ace0-d7b317461fed None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:50.154101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88714311-340c-440f-ace0-d7b317461fed None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:50.159072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:50.159655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:50.159932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:50.160203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:50.160877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:50.161168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:50.187304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:50.192501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 394/787] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:50.198251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:50.208091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0f5ab-4a29-4982-9386-bcdfc8ebf1e4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:50.214804 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:50.215607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:50.215941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:50.216265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:50.217458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:50.217796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:50.242939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154ba96-761a-42e1-8875-958166443adb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:50.248387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 394/788] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:32:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:50.256716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:50.266713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5a64-fff7-4c37-974d-e05288fc38dd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:50.271990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf37be-a767-47bc-b4c7-3b7f96ad9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:50.272560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf37be-a767-47bc-b4c7-3b7f96ad9f49 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:50.272848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf37be-a767-47bc-b4c7-3b7f96ad9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:50.273131 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf37be-a767-47bc-b4c7-3b7f96ad9f49 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:50.273818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf37be-a767-47bc-b4c7-3b7f96ad9f49 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:50.307151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf37be-a767-47bc-b4c7-3b7f96ad9f49 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:50.331792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 395/789] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:32:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:32:52.371385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb311e-b3b9-44cc-ad03-71a7791f1ecf None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:52.372174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb311e-b3b9-44cc-ad03-71a7791f1ecf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:52.372174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb311e-b3b9-44cc-ad03-71a7791f1ecf None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:52.375059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 395/790] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:52.384112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62073d31-9913-4a42-947c-da31c281400e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:52.384527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62073d31-9913-4a42-947c-da31c281400e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:52.384754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62073d31-9913-4a42-947c-da31c281400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:52.415242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-62073d31-9913-4a42-947c-da31c281400e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:52.416382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-62073d31-9913-4a42-947c-da31c281400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:52.436071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 396/791] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:52 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:52.471448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb311e-b3b9-44cc-ad03-71a7791f1ecf None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:52.485273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb311e-b3b9-44cc-ad03-71a7791f1ecf None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:52.489953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:52.490523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:52.490851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:52.491173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:52.491820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:52.517698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:52.519192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.common [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 18:32:52.541215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.sql.core [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 28 18:32:52.541215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 28 18:32:52.541215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [parameters: {'id': 'a1d00d8fe4f543c788b349f1935c4b9e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 28 18:32:52.541215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66296) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Feb 28 18:32:52.555465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1d00d8fe4f543c788b349f1935c4b9e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1d00d8fe4f543c788b349f1935c4b9e. Feb 28 18:32:52.556781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 396/792] 10.222.0.18 () {60 vars in 1161 bytes} [Mon Feb 28 18:32:52 2022] POST /identity/v3/projects => generated 262 bytes in 86 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:52.564030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62073d31-9913-4a42-947c-da31c281400e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:52.578201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62073d31-9913-4a42-947c-da31c281400e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:52.586777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:52.587954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:52.588464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:52.588918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:52.599837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:52.625744 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:52.641200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-b1396462-2a7b-4556-a3e2-a81169835f72 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:32:52.642308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 397/793] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:32:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:52.649708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:52.666302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434fc37-1cb4-44ff-885b-e5b0d16726a1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:52.673258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:52.673840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:52.674133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:52.674421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:52.675168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:52.675474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:52.701426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230149-588d-4217-8204-3d0bd2888e97 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:52.719555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 397/794] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:32:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:54.724248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad667e-d498-47a0-b9d7-72c06a5f10ea None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:54.725087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad667e-d498-47a0-b9d7-72c06a5f10ea None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:54.725087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad667e-d498-47a0-b9d7-72c06a5f10ea None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:54.727832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 398/795] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:54.733252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:54.733702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:54.733792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:54.757155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:54.758645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:54.766924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 398/796] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:54 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:32:54.790618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad667e-d498-47a0-b9d7-72c06a5f10ea None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:54.810044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad667e-d498-47a0-b9d7-72c06a5f10ea None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:54.817646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:54.818614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:54.819080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:54.819535 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:54.820551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:54.853336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:54.854681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.common [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 18:32:54.868099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.sql.core [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 28 18:32:54.868099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 28 18:32:54.868099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [parameters: {'user_id': 'e6cb378e06164801ad26816363ef4abf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 28 18:32:54.868099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66297) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Feb 28 18:32:54.883182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 28 18:32:54.884386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 399/797] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:32:54 2022] POST /identity/v3/users => generated 160 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:54.890841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:54.900973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf21d5-90b8-42b3-940f-cacc9d7c82ff None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:54.907355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:54.908552 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:54.908993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:54.909421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:54.926395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:54.951906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:54.970593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1abf83c6-ec0d-4b2f-a483-8cb913c7e4c9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 18:32:54.971698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 399/798] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:32:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:54.981661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:54.994178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696798e4-3924-42b6-8f4b-58fa0798c346 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:55.000099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:55.000685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:55.000972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:55.001250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:55.002007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:55.002304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:55.028254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e7ffd-af8a-420c-9cdd-ac59ec13ea8f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:55.064404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 400/799] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Feb 28 18:32:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:57.130293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c62d6-779f-4b37-9168-0df1a3f5e518 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:57.130908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c62d6-779f-4b37-9168-0df1a3f5e518 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:57.130908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c62d6-779f-4b37-9168-0df1a3f5e518 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:57.132573 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 400/800] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:57.139199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:57.139898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:57.140085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:57.170661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:57.172135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:57.179499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 401/801] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:57 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:57.203003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c62d6-779f-4b37-9168-0df1a3f5e518 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:57.216921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c62d6-779f-4b37-9168-0df1a3f5e518 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:57.221431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:57.222143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:57.222421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:57.222724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:57.237475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:57.262671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:57.282725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:57.284498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 401/802] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:57.294343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:57.308720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea99589-5551-4772-be4f-9546c047b1c8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:57.315024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:57.315618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:57.315903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:57.316180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:57.316867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:57.317165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:57.342858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0a573-2dac-45ed-be25-2f19060c497c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:57.356707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 402/803] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:57.366039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:57.378403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e97a4-ccc5-4a39-bb09-c21f6f9136d0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:57.383695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca159366-b1cb-4c1b-8e26-7dc559e64a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:57.384221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159366-b1cb-4c1b-8e26-7dc559e64a79 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:57.384501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159366-b1cb-4c1b-8e26-7dc559e64a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:57.384778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159366-b1cb-4c1b-8e26-7dc559e64a79 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:57.385420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159366-b1cb-4c1b-8e26-7dc559e64a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:57.410875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159366-b1cb-4c1b-8e26-7dc559e64a79 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:57.438443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 402/804] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:32:57 2022] POST /identity/v3/users => generated 249 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:32:59.440729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a723-6ea2-4589-a555-de282345317e None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.441664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a723-6ea2-4589-a555-de282345317e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.441664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3a723-6ea2-4589-a555-de282345317e None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.444367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 403/805] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:32:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:32:59.451408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.451843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.452000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.482468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:32:59.483587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:32:59.492741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 403/806] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:32:59 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:32:59.519493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a723-6ea2-4589-a555-de282345317e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:59.540188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3a723-6ea2-4589-a555-de282345317e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:59.545086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:59.545798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.546084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.546359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.558965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:32:59.565834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:32:59.566957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 404/807] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:32:59.573452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:59.587868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c45dba-0667-4aab-92ee-272eb1e811f6 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:59.595103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:59.595695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.595979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.596254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.596959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:59.597255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:59.622269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:59.631968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 404/808] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:32:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:59.641801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:59.656590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866a09-cd69-4341-8898-3dca75bb1fe8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:59.660897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:59.661606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.661891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.662166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.674291 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:59.699806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:59.719972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:32:59.721077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 405/809] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:59.727690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:59.743646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485cc8-0b3d-475f-b556-abf61b1ab34d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:59.750713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:59.751300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.751590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.751868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.752565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:59.752867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:59.778634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:59.792501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 405/810] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:32:59.801563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:59.817122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65977de3-56e6-4dc9-af2b-624ec5e03c84 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:59.825711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:59.826765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.827116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.827499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.848355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:59.877101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:59.895573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 18:32:59.896648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 406/811] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:32:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:32:59.905949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:32:59.915993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aac69f-6554-4289-b18e-68bdbac19d17 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:32:59.921244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:32:59.921826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:32:59.922116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:32:59.922397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:32:59.923227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:32:59.923531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:32:59.948853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:32:59.993799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 406/812] 10.222.0.18 () {56 vars in 1160 bytes} [Mon Feb 28 18:32:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:33:00.003761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:00.017922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d1fa7-f3b8-4a6c-8a61-6c326cd8e0e6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:00.024826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:00.025822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:00.026278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:00.026818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:00.039842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:00.073194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:00.083501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 407/813] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:00 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:00.093324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:00.107750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b1af3-39cd-4c5f-9e8c-597401ab3ac5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:00.113934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:00.114671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:00.114952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:00.115253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:00.127418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:00.153357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:00.171822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:00.172914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 407/814] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:00.179251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:00.190804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abcdcc-49b7-4b97-ada7-31756af424f5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:00.196229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:00.196815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:00.197097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:00.197374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:00.198054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:00.198351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:00.224029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:00.238599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 408/815] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:00.248268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:00.263432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a949c7-9365-4120-a4b1-b6abc514a05e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:00.270983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:00.272090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:00.272551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:00.272995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:00.285386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:00.310711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:00.325255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:00.326078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 408/816] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:00.335317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:00.347433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e23c0d-e236-4ea3-a3d0-781d742fccc4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:00.352622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:00.353209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:00.353496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:00.353778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:00.354526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:00.354859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:00.380290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c012ef7-8d9e-466b-bc16-e2e4c53a8e10 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:00.394264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 409/817] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:00.400833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:00.411847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cda1b3-f0aa-44fd-8aae-80baa8ef5195 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:00.416978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:00.417545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:00.417826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:00.418094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:00.418903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=05012414e8a946fcbbaef5a317a19433) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:00.419196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:00.444376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0646cc-283e-4dbb-8540-b17b343385c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:00.450622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 409/818] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:00 2022] GET /identity/v3/role_assignments?user.id=05012414e8a946fcbbaef5a317a19433&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:02.409419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d110-ffd2-4a7c-bce6-da93463dacc8 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.410239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d110-ffd2-4a7c-bce6-da93463dacc8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.410375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d110-ffd2-4a7c-bce6-da93463dacc8 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.413038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 410/819] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:02.420833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.421364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.421364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.445933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:02.447101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:02.455428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 410/820] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:02 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:33:02.478573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d110-ffd2-4a7c-bce6-da93463dacc8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.491908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d110-ffd2-4a7c-bce6-da93463dacc8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.497166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.497607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.497893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.498169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.510865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:02.517152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:33:02.518218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 411/821] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:02.524641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.535344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71272969-c81a-42f5-ad61-58e90c866aa9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.541360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.541948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.542232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.542505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.543266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:02.543595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:02.568994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:02.578191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 411/822] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:02.587030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.598809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5a5a-6754-4696-ad15-9d056b9f21eb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.604858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.605557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.605843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.606128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.617836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:02.646909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:02.666135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:02.667450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 412/823] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:02.674159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.688312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d5fb-6278-47ed-a883-609622e55679 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.694339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.694969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.695253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.695533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.696219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:02.696522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:02.722190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:02.736567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 412/824] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:02.745433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.755543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aa8b2-66ec-402c-a884-1d0097875b5d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.761519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.762259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.762546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.762853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.777667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:02.802971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:02.821965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 18:33:02.823119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 413/825] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:02.832307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.848206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043801-9cae-40c4-9344-44dd48799a33 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.856769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.857360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.857642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.857921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.858766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:02.859067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:02.884465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:02.915161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 413/826] 10.222.0.18 () {56 vars in 1160 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:02.921425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:02.937060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8968e12-b6c2-4233-b767-51d82bf90b14 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:02.945302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:02.946334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:02.946783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:02.947148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:02.967525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:02.997918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:03.015563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:03.016624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 414/827] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:03.025626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:03.041389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277546b2-c393-4ce9-b2c0-0765229a8020 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:03.047687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:03.048266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:03.048549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:03.048841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:03.049526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:03.049823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:03.075785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:03.091522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 414/828] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:03.097879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:03.111282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec69b2b-9d88-41fa-891e-98279dab4893 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:03.116122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:03.116831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:03.117111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:03.117385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:03.127623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:03.153056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:03.167283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:03.168365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 415/829] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:03.174324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:03.184351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c5e2e-4a23-4c25-a537-d61a0294ed64 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:03.190185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:03.191032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:03.191324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:03.191606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:03.192351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:03.192650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:03.218642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213ead8-9c4e-44ed-bc33-9ced0bcab990 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:03.233243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 415/830] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:03.239911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:03.252633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3b5ab-d494-4bdc-bdaf-6279f9a2bc33 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:03.258118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125a642-1d6b-41df-b9fe-7ac75bd5500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:03.258967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125a642-1d6b-41df-b9fe-7ac75bd5500f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:03.259260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125a642-1d6b-41df-b9fe-7ac75bd5500f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:03.259539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125a642-1d6b-41df-b9fe-7ac75bd5500f admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/05012414e8a946fcbbaef5a317a19433/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:03.282248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125a642-1d6b-41df-b9fe-7ac75bd5500f admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=05012414e8a946fcbbaef5a317a19433, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:03.308329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125a642-1d6b-41df-b9fe-7ac75bd5500f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:03.328328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 416/831] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:33:03 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/05012414e8a946fcbbaef5a317a19433/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:33:05.276227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fad2c-8b59-4392-9e34-27212f3014c7 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.276760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fad2c-8b59-4392-9e34-27212f3014c7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.276760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fad2c-8b59-4392-9e34-27212f3014c7 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.278830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 416/832] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:05.284781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.285196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.285346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.312912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:05.314041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:05.383856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 417/833] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:05 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:05.413274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fad2c-8b59-4392-9e34-27212f3014c7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.427996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fad2c-8b59-4392-9e34-27212f3014c7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.433655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.434484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.434757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.435034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.447968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:05.454210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:33:05.455317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 417/834] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:05.461873 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.473021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79814f52-11f9-4bcd-abc3-835ad0b8c004 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.479078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.479667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.479953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.480218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.480962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:05.481264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.506744 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.515817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 418/835] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:05.524387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.536015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071995df-69cf-4d80-b051-b5b8efd768db admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.541897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.542656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.542895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.543166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.555117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.580492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.604677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:05.605758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 418/836] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:05.612320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.625554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc52ce6-e427-42d2-a2ac-d81ee4d6ab51 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.630129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.630748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.631038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.631318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.632013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:05.632321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.657634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.671363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 419/837] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:05.677702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.690229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dc4df-d348-4f7a-a46d-9341a8164422 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.694790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.695500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.695785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.696060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.709137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.735961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.754726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 18:33:05.755800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 419/838] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:05.764616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.775198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5930fa-2f3e-464e-9fa2-e2b18ade4ec7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.781233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.781823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.782109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.782392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.783220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:05.783525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.808985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.843423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 420/839] 10.222.0.18 () {56 vars in 1160 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:05.849967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.862258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0af1-9e31-41fb-b2b4-a45c27fd17c4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.868273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.868837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.869114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.869383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.877617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.902996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.912547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 420/840] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:05.920687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:05.931205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4506-4394-42e0-8457-762ff53404dd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:05.937371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:05.938091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:05.938377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:05.938686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:05.952021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:05.977928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:05.995819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:05.996867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 421/841] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:06.003186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:06.015086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bffa-dd16-4b70-bd51-d61f17b7573c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:06.020400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:06.020975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:06.021254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:06.021525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:06.022205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:06.022690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:06.047576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:06.060814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 421/842] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:06.069426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:06.081530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b412-d6ad-4a0c-8d03-f92d50a15e62 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:06.086663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:06.087357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:06.087642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:06.087914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:06.097876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:06.123308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:06.136726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:06.137845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 422/843] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:06.147082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:06.159391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bfbc8-3146-4ff4-8e4e-89392b8df63a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:06.165107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:06.165698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:06.165983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:06.166255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:06.167035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:06.167326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:06.194472 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562a636-f2b1-40f0-9b99-a045590dfc7f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:06.208351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 422/844] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:06.214404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:06.225009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076ce30-fd90-4e6e-945c-52f502e1f0bd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:06.230236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:06.230890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:06.231178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:06.231452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:06.232325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=05012414e8a946fcbbaef5a317a19433) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:06.232624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:06.258172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6c30-6f45-4430-8972-488e90498d37 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:06.263998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 423/845] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:06 2022] GET /identity/v3/role_assignments?user.id=05012414e8a946fcbbaef5a317a19433&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:08.256550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac799a-7a38-455a-9999-0b5ecaed830d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:08.257368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac799a-7a38-455a-9999-0b5ecaed830d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:08.257499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac799a-7a38-455a-9999-0b5ecaed830d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:08.260187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 423/846] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:08.265484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:08.265899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:08.266032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:08.291075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:08.292212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:08.300643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 424/847] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:08 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:08.322684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac799a-7a38-455a-9999-0b5ecaed830d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:08.343115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac799a-7a38-455a-9999-0b5ecaed830d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:08.349645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:08.350784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:08.351191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:08.351590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:08.352546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:08.385657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:08.397036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 18:33:08.398110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 424/848] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:08 2022] GET /identity/v3/services/network => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:08.406488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:08.419753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499608-1544-4a99-905c-66b6a5a7c52c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:08.425778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:08.426367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:08.426677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:08.426952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:08.427631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:08.427923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:08.453234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54be9f8-29da-4029-81a5-26918d885490 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:08.458740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 425/849] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:33:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:08.464498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:08.474994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b894d-2dc7-4aa8-972d-a6c0e19f49a4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:08.480191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:08.480932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:08.481240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:08.481517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:08.482191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] RBAC: Adding query filter params (type=network) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:08.482489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:08.507507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1e758-506b-46ba-9df6-71e54aed8a4e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:08.512686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 425/850] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:33:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:10.483502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de8e40-1c36-4abe-a263-8eeaa6126b4a None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:10.484312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de8e40-1c36-4abe-a263-8eeaa6126b4a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:10.484312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de8e40-1c36-4abe-a263-8eeaa6126b4a None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:10.487040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 426/851] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:10.493446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2841-536e-4885-8861-ea26601aa375 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:10.494163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2841-536e-4885-8861-ea26601aa375 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:10.494307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2841-536e-4885-8861-ea26601aa375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:10.519809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cb0d2841-536e-4885-8861-ea26601aa375 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:10.520982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cb0d2841-536e-4885-8861-ea26601aa375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:10.530029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 426/852] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:10 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:10.564369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de8e40-1c36-4abe-a263-8eeaa6126b4a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:10.583438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de8e40-1c36-4abe-a263-8eeaa6126b4a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:10.590352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030e80-113c-4326-a9f0-7858e84fe4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:10.591285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030e80-113c-4326-a9f0-7858e84fe4fb admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:10.591574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030e80-113c-4326-a9f0-7858e84fe4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:10.591853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030e80-113c-4326-a9f0-7858e84fe4fb admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:10.592525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f030e80-113c-4326-a9f0-7858e84fe4fb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:10.617590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f030e80-113c-4326-a9f0-7858e84fe4fb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:10.637448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 427/853] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:33:10 2022] POST /identity/v3/services => generated 240 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:12.604093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1363ef0-ecfe-4596-bf20-27188ce477f5 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.604641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1363ef0-ecfe-4596-bf20-27188ce477f5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.604641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1363ef0-ecfe-4596-bf20-27188ce477f5 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.606663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 427/854] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:12.612860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.613543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.613798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.641110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:12.642235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:12.661932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 428/855] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:12 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:12.692688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1363ef0-ecfe-4596-bf20-27188ce477f5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:12.706463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1363ef0-ecfe-4596-bf20-27188ce477f5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:12.710981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:12.711689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.711977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.712250 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.712877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:12.738185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:12.748844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 18:33:12.749899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 428/856] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:12 2022] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:12.756670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:12.771232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fd394-cc64-4dfa-b773-58cec8ee1955 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:12.779256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:12.779846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.780134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.780414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.781100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:12.781400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:12.806472 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:12.811948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 429/857] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:33:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:12.820723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:12.836674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc4e1c-6c31-4cad-b1a3-f76150563514 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:12.844115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:12.844686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.844967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.845242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.845906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:12.846203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:12.873141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:12.878439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 429/858] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:33:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:12.884987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:12.895562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c8fc1-b625-4f4c-9ea4-1102a501ea86 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:12.900748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:12.901311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.901592 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.901871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.902864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] RBAC: Adding query filter params (interface=public, service_id=16038af6d0a043d389be4a0275efbab2, region_id=RegionOne) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:12.903013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:12.928146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab1927-0055-4445-924e-039e8e0e9866 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:12.933796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 430/859] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:33:12 2022] GET /identity/v3/endpoints?service_id=16038af6d0a043d389be4a0275efbab2&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:12.939687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:12.949377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc154c-9ae4-4cbe-9368-926f58c53472 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:12.954575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91353894-e0a2-4505-98b5-62e8018a8057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:12.955162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91353894-e0a2-4505-98b5-62e8018a8057 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:12.955442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91353894-e0a2-4505-98b5-62e8018a8057 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:12.955718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91353894-e0a2-4505-98b5-62e8018a8057 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:12.956359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91353894-e0a2-4505-98b5-62e8018a8057 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:12.981631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91353894-e0a2-4505-98b5-62e8018a8057 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:12.988438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 430/860] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:33:12 2022] GET /identity/v3/services => generated 1967 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:33:14.937378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607669-d025-4f16-82ea-83c344fc3f2b None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:14.938223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607669-d025-4f16-82ea-83c344fc3f2b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:14.938401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607669-d025-4f16-82ea-83c344fc3f2b None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:14.941065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 431/861] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:14.946298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:14.946757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:14.946854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:14.971168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:14.972282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:14.980156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 431/862] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:14 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:15.003055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607669-d025-4f16-82ea-83c344fc3f2b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:15.024130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607669-d025-4f16-82ea-83c344fc3f2b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:15.030704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:15.031420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:15.031710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:15.031992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:15.032617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:15.057832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:15.068638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 18:33:15.069693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 432/863] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:15 2022] GET /identity/v3/services/network => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:15.079126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:15.092640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4f204-b86b-4c24-b553-0f94d5aa1ede None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:15.097953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:15.098539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:15.098857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:15.099133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:15.099814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:15.100113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:15.125319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:15.130588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 432/864] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:33:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:15.136933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:15.152659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c4713-be31-4e67-b261-d1e4f892ea10 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:15.157968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:15.158546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:15.158862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:15.159144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:15.159813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:15.160116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:15.185177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37f60-18fc-4229-9c1d-364b85197dc2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:15.190382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 433/865] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Feb 28 18:33:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:15.196035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:15.205796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b98d6-eef4-4dac-9e1f-0c426a30d530 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:15.210679 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc930ed3-af02-45a1-9b98-5fd1d476d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:15.210989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930ed3-af02-45a1-9b98-5fd1d476d86b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:15.211275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930ed3-af02-45a1-9b98-5fd1d476d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:15.211560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930ed3-af02-45a1-9b98-5fd1d476d86b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:15.212272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc930ed3-af02-45a1-9b98-5fd1d476d86b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:15.238009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc930ed3-af02-45a1-9b98-5fd1d476d86b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:15.261328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 433/866] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:33:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:17.372177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60a283-74dd-4a33-afdf-cb0a26f26aa7 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:17.373093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60a283-74dd-4a33-afdf-cb0a26f26aa7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:17.373093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60a283-74dd-4a33-afdf-cb0a26f26aa7 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:17.375833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 434/867] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:17.382179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:17.382932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:17.383089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:17.413979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:17.415150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:17.440068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 434/868] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:17.467030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60a283-74dd-4a33-afdf-cb0a26f26aa7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:17.485696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60a283-74dd-4a33-afdf-cb0a26f26aa7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:17.490802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:17.491388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:17.491672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:17.491950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:17.492640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:17.518294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:17.526698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.sql.core [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 28 18:33:17.526698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 28 18:33:17.526698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [parameters: {'id': '6cf40d5f0625476d908435c4d5e069c1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 28 18:33:17.526698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66297) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Feb 28 18:33:17.532708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 28 18:33:17.533814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 435/869] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:33:17 2022] POST /identity/v3/roles => generated 144 bytes in 67 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:17.543454 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:17.552303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c57c-46a6-4d0b-984d-ddcaa0a5eca9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:17.558084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a46f8a-12d8-4f19-9dea-fb066d6e3ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:17.559057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a46f8a-12d8-4f19-9dea-fb066d6e3ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:17.559341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a46f8a-12d8-4f19-9dea-fb066d6e3ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:17.559614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a46f8a-12d8-4f19-9dea-fb066d6e3ae4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:17.571867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a46f8a-12d8-4f19-9dea-fb066d6e3ae4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:17.578417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-d7a46f8a-12d8-4f19-9dea-fb066d6e3ae4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 18:33:17.579543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 435/870] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Feb 28 18:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:17.588498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:17.605057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764be0e1-2bf7-41dd-aa98-3cf5e4569f34 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:17.613943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:17.614803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:17.615125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:17.615555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:17.616605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:17.616961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:17.649533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dd9b9-48bf-4fed-a37c-1f01150302cb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:17.659836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 436/871] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:19.679323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eaee4-ec58-4fc5-8c76-795ea9a8cd96 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:19.680155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eaee4-ec58-4fc5-8c76-795ea9a8cd96 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:19.680155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eaee4-ec58-4fc5-8c76-795ea9a8cd96 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:19.682892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 436/872] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:19.689635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:19.690069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:19.690243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:19.717856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:19.719002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:19.728088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 437/873] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:19.764538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eaee4-ec58-4fc5-8c76-795ea9a8cd96 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:19.780165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151eaee4-ec58-4fc5-8c76-795ea9a8cd96 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:19.786201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:19.786963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:19.787247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:19.787527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:19.800289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:19.825917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:19.845523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:19.846709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 437/874] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:19.853292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:19.862894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f4256-f94e-4856-ad9f-c57048480126 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:19.868347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:19.868942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:19.869232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:19.869508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:19.870203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:19.870500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:19.895908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b40cb-20dc-4f8a-bf54-0772a929212f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:19.910241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 438/875] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:19.919502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:19.929593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267aaf6-1c27-4bee-85b1-173e234ba9d3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:19.935898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be0bf-d965-4382-88e5-dfb19bd61708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:19.936481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be0bf-d965-4382-88e5-dfb19bd61708 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:19.936762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be0bf-d965-4382-88e5-dfb19bd61708 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:19.937038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be0bf-d965-4382-88e5-dfb19bd61708 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:19.937699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be0bf-d965-4382-88e5-dfb19bd61708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:19.963618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be0bf-d965-4382-88e5-dfb19bd61708 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:19.992252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 438/876] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:33:19 2022] POST /identity/v3/users => generated 247 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:33:21.975334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f6a91-b525-4f13-84b2-7cf947880fdb None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:21.976236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f6a91-b525-4f13-84b2-7cf947880fdb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:21.976236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f6a91-b525-4f13-84b2-7cf947880fdb None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:21.978987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 439/877] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:21.985378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:21.986111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:21.986253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.019955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:22.021109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:22.028932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 439/878] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:22.052118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f6a91-b525-4f13-84b2-7cf947880fdb None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.069974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f6a91-b525-4f13-84b2-7cf947880fdb None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.074914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.075904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.076238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.078149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.089259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:22.095880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:33:22.096957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 440/879] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:22.103807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.117781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7430e-7799-48e1-a7c7-43df6467e65b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.126092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.127117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.127575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.128017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.129171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:22.129546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.157512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.166651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 440/880] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:22.172380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.182710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e98cb-1b89-4594-823d-267ce23e956a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.187002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.187713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.187998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.188278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.200095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.225786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.244407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:22.245512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 441/881] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:22.252096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.265333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1696b8-8916-4861-97a6-d993c9e1bbfe admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.269673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.270260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.270574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.270865 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.271561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:22.271864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.297245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.309667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 441/882] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:22.320099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.335752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85355-2554-49b4-a0be-92d50154d61f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.343499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.344211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.344495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.344751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.358786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.384196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.402320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:33:22.403467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 442/883] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:22.409563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.425707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25873644-2e83-43ce-a2e4-f16e9f300fb7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.431403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.431993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.432272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.432544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.433446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:22.433761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.459003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.489465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 442/884] 10.222.0.18 () {56 vars in 1156 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:22.495307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.505369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463b165-0119-4418-a2a3-bdbedecb31f9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.510202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.510791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.511081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.511428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.519681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.545427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.554601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 443/885] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:22.561206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.577510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434780-0f4f-4069-b6b8-9a7817632f7b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.586412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.587586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.588056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.588519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.601784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.627871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.645820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:22.646930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 443/886] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:22.654755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.663390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc10ac9-16f0-4ec0-a544-7082df13f99e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.669500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.670071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.670350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.670659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.671337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:22.671634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.696528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.709827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 444/887] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:22.716689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.731655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babb1d4-67c6-4e69-8e5f-0bcc13f89fd7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.736281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.737001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.737293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.737571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.747376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.772924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.786970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:22.788034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 444/888] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:22.794860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.811571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55276f68-dfbf-401e-8081-1af46e66a128 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.820520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.821491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.821970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.822440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.823796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:22.824297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.850315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1430a5c-d223-430c-a2b5-877e150dfd87 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.864724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 445/889] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:22.874904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:22.885105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac603b6-89ae-4f93-8871-d4cf90120013 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:22.891141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:22.891714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:22.891997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:22.892269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:22.893074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=08b74d6c68e049ad8744b504680d1af0) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:22.893371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:22.919216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab61a5-6016-4836-ad2f-aed4f9093ca6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:22.925154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 445/890] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:22 2022] GET /identity/v3/role_assignments?user.id=08b74d6c68e049ad8744b504680d1af0&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:24.895172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1df3a-f2ae-4651-b057-6205d4c0e3b8 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:24.895723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1df3a-f2ae-4651-b057-6205d4c0e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:24.895723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1df3a-f2ae-4651-b057-6205d4c0e3b8 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:24.897406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 446/891] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:24.903819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c95c7-e953-498f-a283-0945591736bf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:24.904580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c95c7-e953-498f-a283-0945591736bf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:24.904888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c95c7-e953-498f-a283-0945591736bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:24.934351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-211c95c7-e953-498f-a283-0945591736bf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:24.935580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-211c95c7-e953-498f-a283-0945591736bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:24.943641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 446/892] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:24.965836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1df3a-f2ae-4651-b057-6205d4c0e3b8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:24.979327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1df3a-f2ae-4651-b057-6205d4c0e3b8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:24.984657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:24.985365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:24.985647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:24.985923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:24.998300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:25.004560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:33:25.005627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 447/893] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:25.012025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c95c7-e953-498f-a283-0945591736bf None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.022582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c95c7-e953-498f-a283-0945591736bf None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.028750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.029642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.029926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.030195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.030937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:25.031227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.056654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.065828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 447/894] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:25.074453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.085362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0327-ca7d-4707-8ffc-c4eeecf81255 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.091211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.091906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.092196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.092479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.105319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.130868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.151366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:25.152381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 448/895] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:25.159209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.172824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2694db-0a52-4d51-a0b6-e29765e2bd65 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.177083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.177671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.177954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.178230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.178952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:25.179253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.206036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.221413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 448/896] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:25.227830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.239532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b5eb9-8d13-47f9-be97-ea76865de704 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.244957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.245680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.245967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.246248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.259844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.285384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.304034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:33:25.305141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 449/897] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:25.313703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.324083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964802e-baf2-4029-b87e-f6115838160f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.331065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.331640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.331923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.332197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.332980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:25.333271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.362927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.395082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 449/898] 10.222.0.18 () {56 vars in 1156 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:25.401621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.413457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001a93-dcf6-4180-b816-c1d3ce01e531 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.419330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.420340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.420623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.420899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.435338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.460901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.479321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:25.480402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 450/899] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:25.490140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.503340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff67e-5702-4322-b35f-a297623388b2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.508706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.509288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.509520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.509825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.510508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:25.510829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.536934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.550866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 450/900] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:25.559935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.570486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c486d11-e9f7-4743-8298-ed5ddd384ee2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.575959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.576583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.576867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.577140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.587454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.613404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.627812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:25.628870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 451/901] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:25.635247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.647054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da1cd9-e032-420a-9d22-d7315d623e56 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.652500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.653017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.653304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.653580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.654327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:25.654672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.679897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4f73a-f669-4852-988a-be63c3686972 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.694963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 451/902] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:25.701513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:25.711728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d933e-fc98-4677-8a8d-a71b80e101c7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:25.717153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b632efe-a401-4b7e-b51e-d467a8fcc99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:25.718009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b632efe-a401-4b7e-b51e-d467a8fcc99f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:25.718293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b632efe-a401-4b7e-b51e-d467a8fcc99f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:25.718548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b632efe-a401-4b7e-b51e-d467a8fcc99f admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/08b74d6c68e049ad8744b504680d1af0/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:25.743820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b632efe-a401-4b7e-b51e-d467a8fcc99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=08b74d6c68e049ad8744b504680d1af0, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:25.770037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b632efe-a401-4b7e-b51e-d467a8fcc99f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:25.786614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 452/903] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:33:25 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/08b74d6c68e049ad8744b504680d1af0/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:33:27.744562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5be4c-478f-49ec-b54d-59a3e46b575d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:27.745114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5be4c-478f-49ec-b54d-59a3e46b575d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:27.745114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5be4c-478f-49ec-b54d-59a3e46b575d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:27.746855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 452/904] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:27.753146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:27.753907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:27.754044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:27.787586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:27.788707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:27.854580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 453/905] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:27.878268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5be4c-478f-49ec-b54d-59a3e46b575d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:27.894022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5be4c-478f-49ec-b54d-59a3e46b575d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:27.902044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:27.903180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:27.903582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:27.904045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:27.922740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:27.929060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:33:27.930195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 453/906] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:33:27.936363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:27.945238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c327ed5-7113-477d-9fef-b95fab283463 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:27.950287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:27.950976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:27.951261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:27.951542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:27.952252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:27.952547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:27.978029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:27.987117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 454/907] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:27.993331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.091397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4b9c1-72ba-463a-819a-290990f8b13b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.100775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.101906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.102373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.102881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.118169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.143727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.161210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:28.162300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 454/908] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:28.171289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.181067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501ae24-3b7a-4087-8376-e38f05862cbf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.185982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.186579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.186890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.187173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.187865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:28.188168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.213568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.228081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 455/909] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:28.234626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.249949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5409f4-c5c4-4b6d-abd2-5fc923f21f35 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.255130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.255839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.256117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.256389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.269367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.294495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.312511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:33:28.313574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 455/910] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:28.322934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.338937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230614a-4d87-46f2-8c57-7eadf43d33db admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.346150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.346713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.347006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.347287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.348086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:28.348390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.373629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.403984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 456/911] 10.222.0.18 () {56 vars in 1156 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:28.410615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.424129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660842a-5a75-496d-82de-f7a38b146c2a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.431003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.431807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.432217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.432609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.441579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.467285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.476982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 456/912] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:28.483555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.498949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc66a6f-fb89-4f27-bfe5-dffbcd68be06 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.504795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.505515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.505800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.506079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.519422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.544861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.561909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:28.563028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 457/913] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:28.572144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.586666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9be69e-a003-477f-b795-efe95901d68b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.594694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.595300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.595589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.595864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.596616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:28.596850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.622119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.635910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 457/914] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:28.641977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.657398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdbf94-482b-481b-a6a5-8a6cf8829733 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.665378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.666469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.666968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.667410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.679358 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.704785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.719343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:28.720411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 458/915] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:28.727066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.743465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b05b9-f7bb-46ae-a60b-64c4270296f2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.748243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.749006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.749322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.749639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.750443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:28.750825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.780567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb83dd-0992-458b-bc81-dd002332e791 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.794418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 458/916] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:28.805273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:28.821502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb5bd6-44eb-48c4-811c-db9fa739b3aa admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:28.828778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:28.829351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:28.829642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:28.829920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:28.830739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=08b74d6c68e049ad8744b504680d1af0) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:28.831043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:28.856732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfb52d-3fca-48fe-8d7a-e50c8c02620e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:28.863380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 459/917] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:28 2022] GET /identity/v3/role_assignments?user.id=08b74d6c68e049ad8744b504680d1af0&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:30.869023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5960-a356-4151-8f43-b9f403b4056c None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:30.869968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5960-a356-4151-8f43-b9f403b4056c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:30.869968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5960-a356-4151-8f43-b9f403b4056c None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:30.873106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 459/918] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:30.878781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:30.879211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:30.879309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:30.982391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:30.983585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:30.991929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 460/919] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:31.016040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5960-a356-4151-8f43-b9f403b4056c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.037992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5960-a356-4151-8f43-b9f403b4056c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.046231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.047024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.047306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.047593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.059768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:31.065996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:33:31.067102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 460/920] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:31.076618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.085353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38edcff-abe2-4b48-8e95-900a85667357 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.091716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.092335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.092626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.092901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.093631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:31.093928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.118982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.128341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 461/921] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:31.134760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.147664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3461a9-4d51-46d1-8df8-ac13cbcccd24 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.153835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.154538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.154856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.155131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.168231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.193648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.211383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:31.212513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 461/922] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:31.219072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.228448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3c001-d35a-465c-bfe2-46677e0114f8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.233110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.233686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.233971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.234251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.234992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:31.235294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.260237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.274025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 462/923] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:31.280412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.296251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac23b-1729-43fc-9907-6e6c28d8bf67 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.305102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.306219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.306754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.307222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.321332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.347500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.365673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:33:31.366742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 462/924] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:31.374953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.384910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aec276-7398-4740-9d0c-84c65b15a0fa admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.390955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.391549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.391834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.392106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.392904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:31.393201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.418341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.448496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 463/925] 10.222.0.18 () {56 vars in 1156 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:31.455235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.469483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8542-657a-4338-aa65-1141ebd237fa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.474848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.475410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.475690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.475943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.484427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.509569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.519557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 463/926] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:31.525378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.535769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb86abf-be03-4409-861e-41ddd508f7cb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.541639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.542350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.542659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.542934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.555250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.581539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.599353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:31.600394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 464/927] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:31.606607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.616073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30971-5555-4815-8492-3f59122ce428 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.622119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.623089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.623389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.623659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.624337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:31.624629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.650070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.663790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 464/928] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:31.670304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.679991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c119-f4ae-4a05-9308-8cc9e4b6bed2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.684427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.685145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.685459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.685742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.695533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.721216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.735188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:31.736237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 465/929] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:31.742861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.758478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb46acf-5f39-4f80-b374-d5c621c1b2d0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.765714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.766286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.766581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.766867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.767762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:31.768061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.793182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7264ca7-851d-4a00-b808-a1daaf12b50d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.807898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:31.817736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:31.830600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ab2f-bad0-4bb9-8e0b-d5e5b8f888b2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:31.836013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:31.836590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:31.836878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:31.837157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:31.837947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=08b74d6c68e049ad8744b504680d1af0) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:31.838251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:31.868302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4166f6-e6f9-481a-af5b-bfba8ebcb505 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:31.874697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 466/931] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:31 2022] GET /identity/v3/role_assignments?user.id=08b74d6c68e049ad8744b504680d1af0&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:33.815942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cecd1-f22e-4d9b-af92-8e1366817494 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:33.816784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cecd1-f22e-4d9b-af92-8e1366817494 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:33.816784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cecd1-f22e-4d9b-af92-8e1366817494 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:33.820285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 466/932] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:33.829852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:33.830262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:33.830485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:33.858550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:33.859706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:33.867516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 467/933] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:33.891374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cecd1-f22e-4d9b-af92-8e1366817494 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:33.912548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cecd1-f22e-4d9b-af92-8e1366817494 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:33.919893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:33.920607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:33.920889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:33.921171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:33.934042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:33.940238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:33:33.941316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:33.947221 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:33.956673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea6035-0fb7-434a-90f1-9cba4a6e5a4d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:33.962486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:33.963108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:33.963389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:33.963662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:33.964371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:33.964666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:33.990828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.000612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:34.006956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.020285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ede7bd-7d7f-4ab4-af27-c7606c9e6808 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.025003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.025703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.025990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.026270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.039018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.064744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.082513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:34.083558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:34.089658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.099934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b87f51-0546-4b52-a269-d90161df9b0b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.104559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.105139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.105425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.105706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.106393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:34.106728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.132667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.146530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 469/937] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:34.152767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.168422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a34488-8b67-4812-bde4-96a93bd9a012 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.173581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.174289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.174593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.174891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.188090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.213571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.232916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:33:34.234011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 469/938] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:34.243288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.255320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410b7a-2704-425c-b0be-b370232b2df3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.259950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.260627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.260912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.261188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.261989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:34.262288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.288044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.322584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 470/939] 10.222.0.18 () {56 vars in 1156 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:34.330985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.341620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9e8eb-d5d2-438c-9d7c-a78ad7c7bab5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.346488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.347224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.347503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.347777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.361022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.386686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.404118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:34.405176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 470/940] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:33:34.415243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.430482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f74db-734d-4001-9451-0a41a21d0014 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.437949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.438536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.438847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.439125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.439821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:34.440115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.465786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.479658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 471/941] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:34.486148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.500827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8e5d9-b9fb-4473-a604-35eacb82b2ec admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.505939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.506672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.506948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.507192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.517834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.547771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.561936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:34.564592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 471/942] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:34.574034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.591296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e71f6-8aad-4b36-b57a-29c990334b91 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.599567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.600279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.600698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.601074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.602215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:34.602639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.630304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921bd28-1f26-40a2-93cb-fb72bcf3b0c5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.645912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 472/943] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:34.656397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:34.666509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3e62-0a67-402b-9096-8588dc41f2ba admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:34.671913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a7be-ad87-4ad7-91ff-852ad9f499f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:34.672713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a7be-ad87-4ad7-91ff-852ad9f499f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:34.672999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a7be-ad87-4ad7-91ff-852ad9f499f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:34.673261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a7be-ad87-4ad7-91ff-852ad9f499f3 admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/08b74d6c68e049ad8744b504680d1af0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:34.675346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a7be-ad87-4ad7-91ff-852ad9f499f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=08b74d6c68e049ad8744b504680d1af0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:34.701838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a7be-ad87-4ad7-91ff-852ad9f499f3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:34.722072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 472/944] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:33:34 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/08b74d6c68e049ad8744b504680d1af0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:33:36.691228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee20094-d949-4b0d-b418-680cfe043d50 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:36.692075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee20094-d949-4b0d-b418-680cfe043d50 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:36.692075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee20094-d949-4b0d-b418-680cfe043d50 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:36.694815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 473/945] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:36.701160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:36.701870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:36.702056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:36.731832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:36.733157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:36.802753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 473/946] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:33:36.826982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee20094-d949-4b0d-b418-680cfe043d50 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:36.840316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee20094-d949-4b0d-b418-680cfe043d50 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:36.845013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:36.845735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:36.846022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:36.846299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:36.859631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:36.865764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:33:36.866896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 474/947] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:36.873294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:36.882064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f724e3-6454-4802-9764-293aad39c6b0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:36.887972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:36.888891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:36.889188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:36.889459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:36.890179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:36.890477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:36.916099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:36.925362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 474/948] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:36.934844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:36.951840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d9ee-1750-4530-898a-a3b783c761d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:36.957920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:36.958663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:36.958949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:36.959225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:36.975369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.005397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.024160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:37.025260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 475/949] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:37.034620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.048529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384d78-a142-46b7-8c4c-feeeeb239e63 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.054837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.055678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.056033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.056424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.057497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:37.057893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.090280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.104297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 475/950] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:37.114341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.130778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf900754-55c8-4969-9fe7-59b0616d053b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.138365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.139163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.139456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.139735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.152883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.178718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.196429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 18:33:37.197689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 476/951] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:37.203696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.216020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba2f91-f297-41d2-b825-13bc88241caf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.220827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.221426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.221711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.221996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.222828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:37.223134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.248812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.281390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 476/952] 10.222.0.18 () {56 vars in 1156 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:37.287593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.298058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1690157-e545-4830-8b7b-ebab82004913 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.303287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.303858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.304145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.304427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.313056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.338497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.349249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 477/953] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:37.355864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.371210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072d9d6-883b-4b06-8f67-1080b36e009d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.377923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.378678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.378963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.379239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.397732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.425568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.442903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:33:37.444001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 477/954] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:37.453595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.467368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dad38-79c3-40cd-833b-9896bff158f4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.473545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.474134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.474417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.474730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.475438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:37.475723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.501036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.519084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 478/955] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:37.525406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.536637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c8ace-506e-45e7-869c-bf2b00014d5c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.541845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.542548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.542862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.543134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.553078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.578838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.593163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:33:37.594222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 478/956] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:37.603618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.614782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956304a-099f-45b9-bca5-e7be47c58859 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.620672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.621256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.621543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.621821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.622608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:37.622928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.648393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2c6d-87ed-432e-a07d-d8ec904d5d22 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.663235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 479/957] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:37.670846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:37.688103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ce47-8eae-4939-896d-93338fa13f77 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:37.697105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:37.698007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:37.698456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:37.698957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:37.700160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=08b74d6c68e049ad8744b504680d1af0) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:37.700646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:37.727279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4c52c-adde-4e1e-bc3a-f8b9fc67324e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:37.733889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 479/958] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:37 2022] GET /identity/v3/role_assignments?user.id=08b74d6c68e049ad8744b504680d1af0&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:39.761536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d42f6-3ea3-4e9e-9700-1c390b3544bd None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:39.762428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d42f6-3ea3-4e9e-9700-1c390b3544bd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:39.762428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d42f6-3ea3-4e9e-9700-1c390b3544bd None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:39.765486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 480/959] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:39.774486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:39.775225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:39.775443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:39.800585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:39.801721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:39.810000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 480/960] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:39.832460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d42f6-3ea3-4e9e-9700-1c390b3544bd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:39.849261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d42f6-3ea3-4e9e-9700-1c390b3544bd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:39.855290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:39.856008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:39.856289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:39.856558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:39.857721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:39.883335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:39.894998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:33:39.896051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 481/961] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:33:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:39.905406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:39.919627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95eeda-9fef-4895-9820-88f2677d0dd6 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:39.925386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:39.925967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:39.926243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:39.926513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:39.927213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:39.927484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:39.952682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf91eb-3072-4cdf-b30a-8f8a63d2b313 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:39.957942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 481/962] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:39.964297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:39.980446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561b6b1-f2a2-483d-b80a-1330626f5511 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:39.987253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:39.987821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:39.988102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:39.988372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:39.989035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:39.989328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:40.015521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedd084-8f8f-4ff9-b869-63b68f07dbe1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:40.020449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 482/963] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:41.972571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2438a-61d5-432e-9383-732fc8564da3 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:41.973156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2438a-61d5-432e-9383-732fc8564da3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:41.973156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2438a-61d5-432e-9383-732fc8564da3 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:41.974845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 482/964] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:41.981152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d410-0182-4a48-8d36-616bdec1b1ad None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:41.981832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d410-0182-4a48-8d36-616bdec1b1ad None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:41.982369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d410-0182-4a48-8d36-616bdec1b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:42.012341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ffd1d410-0182-4a48-8d36-616bdec1b1ad None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:42.013514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ffd1d410-0182-4a48-8d36-616bdec1b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:42.021877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 483/965] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:42.046784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2438a-61d5-432e-9383-732fc8564da3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:42.061586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2438a-61d5-432e-9383-732fc8564da3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:42.067508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae63e0-e33a-4052-9a41-66612ef2ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:42.068086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae63e0-e33a-4052-9a41-66612ef2ce99 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:42.068370 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae63e0-e33a-4052-9a41-66612ef2ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:42.068650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae63e0-e33a-4052-9a41-66612ef2ce99 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:42.069325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae63e0-e33a-4052-9a41-66612ef2ce99 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:42.094866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae63e0-e33a-4052-9a41-66612ef2ce99 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:42.113745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 483/966] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:33:42 2022] POST /identity/v3/services => generated 241 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:44.112914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d6d3-13e9-467f-aac2-44771a5fd34c None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.113738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d6d3-13e9-467f-aac2-44771a5fd34c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.113738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6d6d3-13e9-467f-aac2-44771a5fd34c None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.116485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 484/967] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:44.125013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.125466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.125559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.159322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:44.160455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:44.181103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 484/968] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:44 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:44.203336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d6d3-13e9-467f-aac2-44771a5fd34c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:44.216268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6d6d3-13e9-467f-aac2-44771a5fd34c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:44.221323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:44.222048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.222333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.222617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.223247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:44.248468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:44.259770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:33:44.260828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 485/969] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:33:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:44.271373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:44.283500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6618e21-8153-42a6-a4eb-18213ad56ce5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:44.289364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:44.289955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.290241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.290520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.291236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:44.291535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:44.316652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:44.322145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 485/970] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:44.328088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:44.338133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70601c5-882e-432f-9a2c-cd326fa5da30 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:44.343742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:44.344329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.344611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.344898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.345608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:44.345910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:44.371209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:44.376445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 486/971] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:44.382493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:44.393274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4ef35-90dd-4e4c-a0e7-114414e4feed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:44.398544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:44.399154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.399435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.399711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.400455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] RBAC: Adding query filter params (interface=public, service_id=92b23aa72d194ad9abc5760bc8900769, region_id=RegionOne) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:44.400755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:44.426913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c92b6-22ed-423c-8a1f-0401beff0ab8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:44.432496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 486/972] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:33:44 2022] GET /identity/v3/endpoints?service_id=92b23aa72d194ad9abc5760bc8900769&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:44.441140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:44.454736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7adf2-39e6-47fb-8566-94c3252e6861 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:44.459793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038303d-424d-482f-8400-3aba6948585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:44.460362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038303d-424d-482f-8400-3aba6948585a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:44.460645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038303d-424d-482f-8400-3aba6948585a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:44.460921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038303d-424d-482f-8400-3aba6948585a admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:44.461564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038303d-424d-482f-8400-3aba6948585a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:44.488491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038303d-424d-482f-8400-3aba6948585a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:44.495763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 487/973] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:33:44 2022] GET /identity/v3/services => generated 2196 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:33:46.452510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e8ec-9936-4c9e-a912-71b1be76566c None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:46.453334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e8ec-9936-4c9e-a912-71b1be76566c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:46.453334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e8ec-9936-4c9e-a912-71b1be76566c None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:46.456124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 487/974] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:46.462465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:46.462904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:46.462991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:46.487118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:46.488239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:46.496214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 488/975] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:46 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:46.519952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e8ec-9936-4c9e-a912-71b1be76566c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:46.537452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e8ec-9936-4c9e-a912-71b1be76566c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:46.542227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:46.542974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:46.543255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:46.543531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:46.544364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:46.569691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:46.581512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:33:46.582576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 488/976] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:33:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:46.588660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:46.598538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30e856-d838-4d6c-a3f0-241827a09890 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:46.603911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:46.604491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:46.604774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:46.605046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:46.605719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:46.606005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:46.631380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:46.636277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 489/977] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:33:46.642001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:46.651840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce8b29-e1b5-415c-9c67-f41207dbdb84 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:46.657129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:46.657687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:46.657970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:46.658242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:46.658937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:46.659229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:46.684276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc673da-8a12-4cd6-a8e4-7484e0daa2b3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:46.689072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 489/978] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:46.695097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:46.707376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70cb54-f86e-4928-a0f7-d5b006407871 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:46.712801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9e2b-2b05-4918-acfd-760310a47903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:46.713314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9e2b-2b05-4918-acfd-760310a47903 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:46.713603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9e2b-2b05-4918-acfd-760310a47903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:46.713884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9e2b-2b05-4918-acfd-760310a47903 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:46.714923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be9e2b-2b05-4918-acfd-760310a47903 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:46.740676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be9e2b-2b05-4918-acfd-760310a47903 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:46.762443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 490/979] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:33:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:48.768824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003eafb-e14a-4b66-9ec2-ce8bd860eae0 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:48.769403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003eafb-e14a-4b66-9ec2-ce8bd860eae0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:48.769403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003eafb-e14a-4b66-9ec2-ce8bd860eae0 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:48.771092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 490/980] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:48.777238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:48.777916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:48.778053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:48.802038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:48.803195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:48.822678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 491/981] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:48.852834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003eafb-e14a-4b66-9ec2-ce8bd860eae0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:48.872479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003eafb-e14a-4b66-9ec2-ce8bd860eae0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:48.877675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:48.878393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:48.878710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:48.878973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:48.879594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:48.905624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:48.916825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:33:48.917892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 491/982] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:33:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:48.925275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:48.939762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090e9f8-8d95-4c8c-ab8c-eb65a1bef29a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:48.947998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:48.948940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:48.949417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:48.949878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:48.950831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:48.951125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:48.976699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:48.981913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 492/983] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:48.990891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:49.008704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5bd6c-eb4a-4508-9123-b90ff3aa9ba3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:49.015757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:49.016330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:49.016609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:49.016877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:49.017540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:49.017830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:49.043019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:49.048306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 492/984] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:49.054754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:49.073422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbecc5-23a0-4d3c-93c8-5809beeb5a94 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:49.079461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:49.080056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:49.080326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:49.080602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:49.081354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] RBAC: Adding query filter params (interface=admin, service_id=92b23aa72d194ad9abc5760bc8900769, region_id=RegionOne) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:49.081653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:49.107108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b853480-bfcb-452b-8d6e-c31cb0538562 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:49.112845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 493/985] 10.222.0.18 () {56 vars in 1270 bytes} [Mon Feb 28 18:33:49 2022] GET /identity/v3/endpoints?service_id=92b23aa72d194ad9abc5760bc8900769&interface=admin®ion_id=RegionOne => generated 193 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:49.118869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:49.129001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c761e-8de2-41d0-b23a-10d0b8b6fe6b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:49.134967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277ec17-0662-4650-a020-b4ae8195734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:49.135542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ec17-0662-4650-a020-b4ae8195734a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:49.135825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ec17-0662-4650-a020-b4ae8195734a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:49.136097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277ec17-0662-4650-a020-b4ae8195734a admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:49.136746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277ec17-0662-4650-a020-b4ae8195734a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:49.162473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277ec17-0662-4650-a020-b4ae8195734a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:49.169299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 493/986] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:33:49 2022] GET /identity/v3/services => generated 2196 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:33:51.180931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c69e-0903-4b7c-abd8-b6c140b3930e None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:51.181517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c69e-0903-4b7c-abd8-b6c140b3930e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:51.181517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391c69e-0903-4b7c-abd8-b6c140b3930e None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:51.183182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 494/987] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:51.188590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:51.189000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:51.189276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:51.212926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:51.214393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:51.222928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 494/988] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:51.245560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c69e-0903-4b7c-abd8-b6c140b3930e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:51.259642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391c69e-0903-4b7c-abd8-b6c140b3930e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:51.265415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:51.266142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:51.266425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:51.266737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:51.267365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:51.292702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:51.304491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 18:33:51.305553 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 495/989] 10.222.0.18 () {56 vars in 1147 bytes} [Mon Feb 28 18:33:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:51.312252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:51.325810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff8b24-2800-4d6e-9968-a63dd5d2a432 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:51.331143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:51.331730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:51.332017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:51.332297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:51.332976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:51.333277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:51.358930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:51.364490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 495/990] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:51.373774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:51.389145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738481a-0e49-4b41-bc6c-d57608bb474d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:51.395074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:51.395656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:51.395942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:51.396227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:51.396893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:51.397193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:51.422397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd754f-4950-4aea-9ea3-7f02509c2944 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:51.427506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 496/991] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Feb 28 18:33:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:51.436587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:51.451443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0a422-be9d-492b-85ba-8efa2b8f90db admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:51.456295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa27156-b0d1-4fc6-9d17-133b682f801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:51.456869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27156-b0d1-4fc6-9d17-133b682f801e admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:51.457153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27156-b0d1-4fc6-9d17-133b682f801e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:51.457432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa27156-b0d1-4fc6-9d17-133b682f801e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:51.458123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa27156-b0d1-4fc6-9d17-133b682f801e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:51.483555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa27156-b0d1-4fc6-9d17-133b682f801e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:51.504588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 496/992] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:33:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:53.513816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407c0d-6d54-4244-a690-cd57f822d69b None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:53.514913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407c0d-6d54-4244-a690-cd57f822d69b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:53.514913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407c0d-6d54-4244-a690-cd57f822d69b None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:53.517581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 497/993] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:53.526115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:53.526524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:53.526749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:53.557220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:53.558373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:53.577956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 497/994] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:53 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:53.601466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407c0d-6d54-4244-a690-cd57f822d69b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:53.615921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407c0d-6d54-4244-a690-cd57f822d69b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:53.620825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa7c5f-ac95-4e15-a660-24bea78cf8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:53.621534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa7c5f-ac95-4e15-a660-24bea78cf8fc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:53.621819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa7c5f-ac95-4e15-a660-24bea78cf8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:53.622101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa7c5f-ac95-4e15-a660-24bea78cf8fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:53.623327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa7c5f-ac95-4e15-a660-24bea78cf8fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:53.648708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa7c5f-ac95-4e15-a660-24bea78cf8fc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:53.650151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 498/995] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:53.656473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:53.669542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1f369-66f6-4a32-a427-39747007aa2b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:53.677592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d6f3-e8f7-4667-a5ab-91a0a5802366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:53.678427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d6f3-e8f7-4667-a5ab-91a0a5802366 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:53.678849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d6f3-e8f7-4667-a5ab-91a0a5802366 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:53.679263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d6f3-e8f7-4667-a5ab-91a0a5802366 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:53.680220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2d6f3-e8f7-4667-a5ab-91a0a5802366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:53.713569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2d6f3-e8f7-4667-a5ab-91a0a5802366 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:53.748652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 498/996] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:33:53 2022] POST /identity/v3/projects => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:55.764624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e570ac-9e34-4efe-83cb-695c26892296 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:55.765214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e570ac-9e34-4efe-83cb-695c26892296 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:55.765214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e570ac-9e34-4efe-83cb-695c26892296 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:55.767019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 499/997] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:55.772575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:55.772994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:55.773109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:55.796895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:55.798030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:55.864446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 499/998] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:55 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:55.888858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e570ac-9e34-4efe-83cb-695c26892296 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:55.910749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e570ac-9e34-4efe-83cb-695c26892296 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:55.919194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ecdf-d6a1-411f-a05f-17e0f61a439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:55.919908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ecdf-d6a1-411f-a05f-17e0f61a439f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:55.920193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ecdf-d6a1-411f-a05f-17e0f61a439f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:55.920469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ecdf-d6a1-411f-a05f-17e0f61a439f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:55.921673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ecdf-d6a1-411f-a05f-17e0f61a439f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:55.947224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ecdf-d6a1-411f-a05f-17e0f61a439f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:55.948699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 500/999] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:55.957744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:55.969328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c136e-830c-4916-ac8d-f67459ab9546 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:55.974940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e6bf2-3d1d-4e84-a761-3f51b6d2f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:55.975535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6bf2-3d1d-4e84-a761-3f51b6d2f1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:55.975823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6bf2-3d1d-4e84-a761-3f51b6d2f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:55.976102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6bf2-3d1d-4e84-a761-3f51b6d2f1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:55.976770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e6bf2-3d1d-4e84-a761-3f51b6d2f1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:56.002203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e6bf2-3d1d-4e84-a761-3f51b6d2f1a5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:56.025612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 500/1000] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:33:55 2022] POST /identity/v3/users => generated 285 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:33:58.007557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb368-7c46-4282-9103-7472c403214a None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.008399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb368-7c46-4282-9103-7472c403214a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.008399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb368-7c46-4282-9103-7472c403214a None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.011161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 501/1001] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:33:58.017313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.017744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.017895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.050108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:33:58.051291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:33:58.059240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 501/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:33:58 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:33:58.082205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb368-7c46-4282-9103-7472c403214a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:58.103380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fb368-7c46-4282-9103-7472c403214a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:58.109695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:58.110406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.110725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.111003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.124178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:33:58.130353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:33:58.131463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 502/1003] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:33:58.137924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:58.151745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b530-66c8-4bd9-9613-1c1a5b7b9b08 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:58.160413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:58.161274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.161664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.162047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.163209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:58.163659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:58.189838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:58.202190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 502/1004] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:58.207989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:58.226960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077bbd-ab25-41a1-abc7-6265b5877300 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:58.232307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:58.233105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.233395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.233679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] PATH_INFO: `/v3/users/e84a0f95d1f748f7a278e5e0b6972d66` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.253857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] RBAC: Authorizing `identity:get_user(user_id=e84a0f95d1f748f7a278e5e0b6972d66)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:58.280045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:58.281486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 503/1005] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:33:58 2022] GET /identity/v3/users/e84a0f95d1f748f7a278e5e0b6972d66 => generated 285 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:58.288171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:58.304378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b390f2b-d6b1-498a-bf9c-6c317cef5f6a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:58.311973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:58.312545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.312833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.313112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.321368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:58.347534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:58.356602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 503/1006] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:33:58 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:33:58.366037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:58.377861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bf83-a856-4ffe-b526-1936384e2208 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:58.383506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e101d-d45c-4df6-8abf-8d88814d9c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:58.384292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e101d-d45c-4df6-8abf-8d88814d9c9c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.384581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e101d-d45c-4df6-8abf-8d88814d9c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.384860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e101d-d45c-4df6-8abf-8d88814d9c9c admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.386109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e101d-d45c-4df6-8abf-8d88814d9c9c admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:58.412083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e101d-d45c-4df6-8abf-8d88814d9c9c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:58.413608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 504/1007] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:33:58 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:33:58.420106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:33:58.434319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c18d-850d-4b6a-b6ea-555fe9d735bd admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:33:58.440592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:33:58.441164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:33:58.441449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:33:58.441730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:33:58.442510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=72086244e029413bbfd2949071c97092, user.id=e84a0f95d1f748f7a278e5e0b6972d66) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:33:58.442847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:33:58.468405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c538c91-fae1-4856-9c51-bbf86f0d4c46 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:33:58.474278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 504/1008] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:33:58 2022] GET /identity/v3/role_assignments?user.id=e84a0f95d1f748f7a278e5e0b6972d66&scope.project.id=72086244e029413bbfd2949071c97092&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:00.413578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7321f4-971a-4719-8891-e12f27aedd38 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.414412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7321f4-971a-4719-8891-e12f27aedd38 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.414412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7321f4-971a-4719-8891-e12f27aedd38 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.417156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 505/1009] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:00.423890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.424322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.424479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.457716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:00.458892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:00.467655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 505/1010] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:00 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:00.500783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7321f4-971a-4719-8891-e12f27aedd38 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:00.516847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7321f4-971a-4719-8891-e12f27aedd38 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:00.522603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:00.523346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.523633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.523909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.536612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:00.542870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:00.543968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 506/1011] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:00.550169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:00.559643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba066-cf62-40af-8c9c-2ba190db6c2d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:00.565009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:00.565596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.565881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.566146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.566890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:00.567182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:00.593145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:00.603013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 506/1012] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:00.612317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:00.627629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa28ab6-e57c-4747-8f9e-ca6401f16c2d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:00.633112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:00.633897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.634183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.634462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] PATH_INFO: `/v3/users/e84a0f95d1f748f7a278e5e0b6972d66` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.635742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] RBAC: Authorizing `identity:get_user(user_id=e84a0f95d1f748f7a278e5e0b6972d66)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:00.661752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:00.663278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 507/1013] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:00 2022] GET /identity/v3/users/e84a0f95d1f748f7a278e5e0b6972d66 => generated 285 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:00.669645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:00.684899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71381b-43bb-43bb-aaa7-bfc12bf05fc2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:00.691063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dde3c2-fe52-439a-855d-363d3c1040eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:00.691842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dde3c2-fe52-439a-855d-363d3c1040eb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.692127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dde3c2-fe52-439a-855d-363d3c1040eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.692396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dde3c2-fe52-439a-855d-363d3c1040eb admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.693717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dde3c2-fe52-439a-855d-363d3c1040eb admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:00.719969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dde3c2-fe52-439a-855d-363d3c1040eb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:00.721469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 507/1014] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:00 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:00.730628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:00.746530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfed016-29be-49a0-a862-2a9c6e3b8d5b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:00.752230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798737b-fc30-45b4-88ff-0fede0052d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:00.752976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798737b-fc30-45b4-88ff-0fede0052d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:00.753260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798737b-fc30-45b4-88ff-0fede0052d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:00.753537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798737b-fc30-45b4-88ff-0fede0052d24 admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092/users/e84a0f95d1f748f7a278e5e0b6972d66/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:00.755621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798737b-fc30-45b4-88ff-0fede0052d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72086244e029413bbfd2949071c97092, user_id=e84a0f95d1f748f7a278e5e0b6972d66, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:00.781733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798737b-fc30-45b4-88ff-0fede0052d24 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:00.803007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 508/1015] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:34:00 2022] PUT /identity/v3/projects/72086244e029413bbfd2949071c97092/users/e84a0f95d1f748f7a278e5e0b6972d66/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:34:02.733729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392581c3-7e06-4e21-998c-0a96792981a7 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:02.734617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392581c3-7e06-4e21-998c-0a96792981a7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:02.734617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392581c3-7e06-4e21-998c-0a96792981a7 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:02.737310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 508/1016] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:02.742904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:02.743343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:02.743444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:02.771111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:02.772826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:02.841245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 509/1017] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:02 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:02.864376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392581c3-7e06-4e21-998c-0a96792981a7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:02.880857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392581c3-7e06-4e21-998c-0a96792981a7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:02.886074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:02.886840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:02.887133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:02.887410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:02.900888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:02.907186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:02.908270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 509/1018] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:02.916852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:02.926023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7072-c11e-4950-a311-6e0b6395d45e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:02.931504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:02.932089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:02.932378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:02.932653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:02.933365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:02.933714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:02.959187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:02.968569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 510/1019] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:02.977718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:02.998671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54022-45bc-474c-abef-bd616c974066 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:03.003284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:03.004158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:03.004520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:03.004888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] PATH_INFO: `/v3/users/e84a0f95d1f748f7a278e5e0b6972d66` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:03.006099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=e84a0f95d1f748f7a278e5e0b6972d66)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:03.040194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:03.041674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 510/1020] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:02 2022] GET /identity/v3/users/e84a0f95d1f748f7a278e5e0b6972d66 => generated 285 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:03.051096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:03.064320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fb3dc-53c6-43ef-a900-07290eac722c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:03.070373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:03.070994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:03.071287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:03.071566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:03.080426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:03.106391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:03.115662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 511/1021] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:03 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:03.123299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:03.138866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b704-f31d-4985-b353-1ed00442b8c5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:03.144328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1c3df-e158-4615-b82d-19bfb2020ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:03.145097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c3df-e158-4615-b82d-19bfb2020ced admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:03.145379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c3df-e158-4615-b82d-19bfb2020ced admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:03.145654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1c3df-e158-4615-b82d-19bfb2020ced admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:03.146899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1c3df-e158-4615-b82d-19bfb2020ced admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:03.172457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1c3df-e158-4615-b82d-19bfb2020ced admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:03.173978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 511/1022] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:03 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:03.180161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:03.189643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748a65-8f54-42d2-a6a0-56147caa9711 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:03.194870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:03.195439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:03.195719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:03.195992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:03.196765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=72086244e029413bbfd2949071c97092, user.id=e84a0f95d1f748f7a278e5e0b6972d66) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:03.197061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:03.222918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ff21f-ff38-4818-97a0-23d6e7cbf8cf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:03.229257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 512/1023] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:03 2022] GET /identity/v3/role_assignments?user.id=e84a0f95d1f748f7a278e5e0b6972d66&scope.project.id=72086244e029413bbfd2949071c97092&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:05.219980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e8430-eb52-474c-897c-1cf23f0c5454 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:05.220438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e8430-eb52-474c-897c-1cf23f0c5454 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:05.220549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e8430-eb52-474c-897c-1cf23f0c5454 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:05.222223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 512/1024] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:05.228429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:05.228866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:05.229008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:05.259004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:05.260122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:05.268506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 513/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:05 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:05.292578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e8430-eb52-474c-897c-1cf23f0c5454 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:05.307288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e8430-eb52-474c-897c-1cf23f0c5454 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:05.312145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ef57-04ac-4a35-b1e3-440e0c2f099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:05.312856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ef57-04ac-4a35-b1e3-440e0c2f099f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:05.313141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ef57-04ac-4a35-b1e3-440e0c2f099f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:05.313422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ef57-04ac-4a35-b1e3-440e0c2f099f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:05.314504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ef57-04ac-4a35-b1e3-440e0c2f099f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:05.340059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ef57-04ac-4a35-b1e3-440e0c2f099f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:05.341533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 513/1026] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:05.350302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:05.361164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcedcf-01f4-4b4e-9007-397994fbb0fa None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:05.366141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd8bb0-a134-4b2e-a535-2544056915bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:05.366764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd8bb0-a134-4b2e-a535-2544056915bc admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:05.367045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd8bb0-a134-4b2e-a535-2544056915bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:05.367320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd8bb0-a134-4b2e-a535-2544056915bc admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:05.367965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd8bb0-a134-4b2e-a535-2544056915bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:05.396477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd8bb0-a134-4b2e-a535-2544056915bc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:05.421706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 514/1027] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:34:05 2022] POST /identity/v3/users => generated 286 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:07.431586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802dff-3a69-4077-9153-ce17cd616f62 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.432475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802dff-3a69-4077-9153-ce17cd616f62 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.432475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65802dff-3a69-4077-9153-ce17cd616f62 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.434804 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 514/1028] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:07.440188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.440588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.440773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.466062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:07.467147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:07.479077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 515/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:07 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:07.501851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802dff-3a69-4077-9153-ce17cd616f62 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:07.516150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65802dff-3a69-4077-9153-ce17cd616f62 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:07.521080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:07.521845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.522127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.522406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] PATH_INFO: `/v3/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.523815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] RBAC: Authorizing `identity:get_role(role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:07.548346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:07.548346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:34:07.548346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:34:07.549220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:07.550480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 515/1030] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:07 2022] GET /identity/v3/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 223 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:07.556853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:07.566503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944de3c-0629-4c1e-be97-3e588d9e15a7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:07.572680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:07.573478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.573764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.574042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] PATH_INFO: `/v3/users/9c4361fa71764fce964d61cfcffcc354` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.593730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4361fa71764fce964d61cfcffcc354)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:07.619451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:07.620985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 516/1031] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:07 2022] GET /identity/v3/users/9c4361fa71764fce964d61cfcffcc354 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:07.630693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:07.643612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e6313-5d7c-4e8c-a2ee-be6bbcbdaf0a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:07.649793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:07.650364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.650686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.650968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.659774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:07.685092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:07.693777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 516/1032] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:07 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:07.700953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:07.717171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d83b-550b-4228-a8a5-e56bfa72fe94 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:07.726068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a1d8d-cf57-474b-8688-f5cf5e5085a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:07.727380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1d8d-cf57-474b-8688-f5cf5e5085a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.727859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1d8d-cf57-474b-8688-f5cf5e5085a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.728320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a1d8d-cf57-474b-8688-f5cf5e5085a6 admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.730321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a1d8d-cf57-474b-8688-f5cf5e5085a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:07.756117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a1d8d-cf57-474b-8688-f5cf5e5085a6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:07.757618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 517/1033] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:07 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:07.767524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:07.782180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2bfd9-a67d-4a27-ab7c-f487b0bea181 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:07.791230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:07.792211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:07.792685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:07.793300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:07.794108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] RBAC: Adding query filter params (role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=72086244e029413bbfd2949071c97092, user.id=9c4361fa71764fce964d61cfcffcc354) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:07.794410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:07.819690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800ba5e-434e-4b24-9ff4-cfb93749c13c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:07.825188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 517/1034] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:07 2022] GET /identity/v3/role_assignments?user.id=9c4361fa71764fce964d61cfcffcc354&scope.project.id=72086244e029413bbfd2949071c97092&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:09.782492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b3e8b-6f76-4746-9d68-05d72f23f5a5 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:09.783388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b3e8b-6f76-4746-9d68-05d72f23f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:09.783388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b3e8b-6f76-4746-9d68-05d72f23f5a5 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:09.786038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 518/1035] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:09.791443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:09.791883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:09.791973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:09.815861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:09.816995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:09.825354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 518/1036] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:09.848509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b3e8b-6f76-4746-9d68-05d72f23f5a5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:09.865534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b3e8b-6f76-4746-9d68-05d72f23f5a5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:09.873172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:09.874337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:09.874668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:09.874956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] PATH_INFO: `/v3/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:09.877601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] RBAC: Authorizing `identity:get_role(role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:09.910220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:09.910220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:34:09.910220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:34:09.911120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:09.912394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 519/1037] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:09 2022] GET /identity/v3/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 223 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:09.920848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:09.929768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3738fec-1385-4d40-abc0-4c1993a28e3d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:09.935972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:09.936762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:09.937046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:09.937323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] PATH_INFO: `/v3/users/9c4361fa71764fce964d61cfcffcc354` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:09.938594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4361fa71764fce964d61cfcffcc354)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:09.964306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:09.965811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 519/1038] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:09 2022] GET /identity/v3/users/9c4361fa71764fce964d61cfcffcc354 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:09.971783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:09.982442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e72083-31f8-4d62-b314-d687887851d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:09.988494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9306276-ecf5-425a-afed-9488382eb059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:09.989268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306276-ecf5-425a-afed-9488382eb059 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:09.989550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306276-ecf5-425a-afed-9488382eb059 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:09.989833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9306276-ecf5-425a-afed-9488382eb059 admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:09.991182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306276-ecf5-425a-afed-9488382eb059 admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:10.016890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9306276-ecf5-425a-afed-9488382eb059 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:10.018393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 520/1039] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:09 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:10.027485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:10.042945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ef612-0e53-4d18-9d34-7a7fe69641fe admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:10.048470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4271b-5aa2-4cc5-a5b7-adef157865b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:10.049272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4271b-5aa2-4cc5-a5b7-adef157865b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:10.049560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4271b-5aa2-4cc5-a5b7-adef157865b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:10.049839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4271b-5aa2-4cc5-a5b7-adef157865b0 admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092/users/9c4361fa71764fce964d61cfcffcc354/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:10.052557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4271b-5aa2-4cc5-a5b7-adef157865b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72086244e029413bbfd2949071c97092, user_id=9c4361fa71764fce964d61cfcffcc354, role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:10.078593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4271b-5aa2-4cc5-a5b7-adef157865b0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:10.095731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 520/1040] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:34:10 2022] PUT /identity/v3/projects/72086244e029413bbfd2949071c97092/users/9c4361fa71764fce964d61cfcffcc354/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:34:12.010323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c41884-b6b2-4cbb-a1a5-8ffe0427b926 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.010919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c41884-b6b2-4cbb-a1a5-8ffe0427b926 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.010919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c41884-b6b2-4cbb-a1a5-8ffe0427b926 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.012675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 521/1041] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:12.018916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.019596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.019768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.046593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:12.047754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:12.114268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 521/1042] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:12.136918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c41884-b6b2-4cbb-a1a5-8ffe0427b926 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:12.151952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c41884-b6b2-4cbb-a1a5-8ffe0427b926 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:12.158020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:12.158823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.159110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.159384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] PATH_INFO: `/v3/roles/a2b037ace14e4fb3bb9417186c8d0853` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.160845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] RBAC: Authorizing `identity:get_role(role_id=a2b037ace14e4fb3bb9417186c8d0853)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:12.185888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:12.191804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 522/1043] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:12 2022] GET /identity/v3/roles/a2b037ace14e4fb3bb9417186c8d0853 => generated 223 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:12.192973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:12.202338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44f8b7-35fa-4573-9592-d71190307490 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:12.206854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:12.207636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.207921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.208196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] PATH_INFO: `/v3/users/9c4361fa71764fce964d61cfcffcc354` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.209325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4361fa71764fce964d61cfcffcc354)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:12.235376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:12.236837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 522/1044] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:12 2022] GET /identity/v3/users/9c4361fa71764fce964d61cfcffcc354 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:34:12.242619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:12.252787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa598f39-0bc1-4194-abeb-ea4a9d104f7a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:12.257652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:12.258222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.258503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.258811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.267534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:12.293054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:12.301949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 523/1045] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:12 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:34:12.311972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:12.326625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdbbb3-1c3d-4fd9-9738-92e7b8db9660 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:12.332193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef76d-c405-438c-b47f-ceffd58f5c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:12.332972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef76d-c405-438c-b47f-ceffd58f5c8a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.333256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef76d-c405-438c-b47f-ceffd58f5c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.333535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef76d-c405-438c-b47f-ceffd58f5c8a admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.334808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef76d-c405-438c-b47f-ceffd58f5c8a admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:12.360857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef76d-c405-438c-b47f-ceffd58f5c8a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:12.362368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 523/1046] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:12 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:12.371788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:12.385862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970c793-a040-4cc7-a987-45231a449d2f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:12.392214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:12.392777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:12.393061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:12.393344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:12.394171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] RBAC: Adding query filter params (role.id=a2b037ace14e4fb3bb9417186c8d0853, scope.project.id=72086244e029413bbfd2949071c97092, user.id=9c4361fa71764fce964d61cfcffcc354) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:12.394481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:12.419846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d00dd2-6add-4e33-b87e-355441e85dff admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:12.426067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 524/1047] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:12 2022] GET /identity/v3/role_assignments?user.id=9c4361fa71764fce964d61cfcffcc354&scope.project.id=72086244e029413bbfd2949071c97092&role.id=a2b037ace14e4fb3bb9417186c8d0853 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:14.441643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13292cfc-b988-4059-b65b-afdbbf6c8868 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:14.442613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13292cfc-b988-4059-b65b-afdbbf6c8868 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:14.442613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13292cfc-b988-4059-b65b-afdbbf6c8868 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:14.445317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 524/1048] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:14.451327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:14.451758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:14.451866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:14.486032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:14.487131 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:14.496034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 525/1049] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:14 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:14.525036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13292cfc-b988-4059-b65b-afdbbf6c8868 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:14.546319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13292cfc-b988-4059-b65b-afdbbf6c8868 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:14.554906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a0a93-f19c-4ab9-b2be-1e678ccc65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:14.555895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a0a93-f19c-4ab9-b2be-1e678ccc65ec admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:14.556208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a0a93-f19c-4ab9-b2be-1e678ccc65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:14.556509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a0a93-f19c-4ab9-b2be-1e678ccc65ec admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:14.558331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a0a93-f19c-4ab9-b2be-1e678ccc65ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:14.590313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a0a93-f19c-4ab9-b2be-1e678ccc65ec admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:14.591845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 525/1050] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:14.601061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:14.611653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d0c8a-e127-49b5-92eb-0eefe8aa84b8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:14.617480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c20dcf-66df-4401-a4a0-2fe26caae9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:14.618067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20dcf-66df-4401-a4a0-2fe26caae9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:14.618352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20dcf-66df-4401-a4a0-2fe26caae9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:14.618658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c20dcf-66df-4401-a4a0-2fe26caae9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:14.619308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c20dcf-66df-4401-a4a0-2fe26caae9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:14.645158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c20dcf-66df-4401-a4a0-2fe26caae9a3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:14.681492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 526/1051] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:34:14 2022] POST /identity/v3/projects => generated 311 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:16.722635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2bfa-2aee-4970-8684-7ad607e1f364 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:16.723479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2bfa-2aee-4970-8684-7ad607e1f364 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:16.723589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2bfa-2aee-4970-8684-7ad607e1f364 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:16.726232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 526/1052] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:16.732018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:16.732460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:16.732551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:16.758409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:16.759547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:16.828611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 527/1053] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:16.853803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2bfa-2aee-4970-8684-7ad607e1f364 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:16.876458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2bfa-2aee-4970-8684-7ad607e1f364 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:16.885330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59084c27-a5f5-42aa-bcf3-7d4af21c87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:16.886467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084c27-a5f5-42aa-bcf3-7d4af21c87bd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:16.886763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084c27-a5f5-42aa-bcf3-7d4af21c87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:16.887099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084c27-a5f5-42aa-bcf3-7d4af21c87bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:16.888413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59084c27-a5f5-42aa-bcf3-7d4af21c87bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:16.913796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59084c27-a5f5-42aa-bcf3-7d4af21c87bd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:16.915279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 527/1054] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:34:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:16.924941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:16.939483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dace0ee-4ffd-4acb-bad9-453f13ceb272 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:16.948404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ee755-2f43-4c30-a9b1-77338b485933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:16.949667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ee755-2f43-4c30-a9b1-77338b485933 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:16.949953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ee755-2f43-4c30-a9b1-77338b485933 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:16.950222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ee755-2f43-4c30-a9b1-77338b485933 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:16.950907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ee755-2f43-4c30-a9b1-77338b485933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:16.976822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ee755-2f43-4c30-a9b1-77338b485933 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:17.003848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 528/1055] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:34:16 2022] POST /identity/v3/users => generated 286 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:19.129950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53b13-64bb-4cb0-953e-2d5fc9adfbf3 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.130606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53b13-64bb-4cb0-953e-2d5fc9adfbf3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.130606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f53b13-64bb-4cb0-953e-2d5fc9adfbf3 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.132203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 528/1056] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:19.138182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.138985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.139149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.174955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:19.176090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:19.184500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 529/1057] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:19 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:19.207397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f53b13-64bb-4cb0-953e-2d5fc9adfbf3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:19.223535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f53b13-64bb-4cb0-953e-2d5fc9adfbf3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:19.229003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:19.229776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.230191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.230473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.244057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:19.250358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:19.251469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 529/1058] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:19.258111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:19.272410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3e901-a17b-45e4-b5cb-1d9c24a44e51 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:19.280115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:19.280697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.280981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.281257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.281973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:19.282266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:19.307557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:19.317543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 530/1059] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:19.326905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:19.339554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb163fb-1acf-4a9f-98b6-28fa4193c28f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:19.345665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:19.346459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.346780 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.347065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] PATH_INFO: `/v3/users/ecd38da316b44c33a55e78e597a54e29` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.367965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=ecd38da316b44c33a55e78e597a54e29)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:19.394725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:19.396182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 530/1060] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:19 2022] GET /identity/v3/users/ecd38da316b44c33a55e78e597a54e29 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:19.402866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:19.418207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea6bd5-e2e2-48f7-913a-7cafb7ca3c71 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:19.426655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:19.427594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.428068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.428536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.436801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:19.462170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:19.471968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 531/1061] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:19 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:19.478357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:19.488197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123c563-d5e6-4923-a259-7da8a7fc6bc0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:19.493376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ead2b-9397-46ae-b56c-2e90ba42811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:19.494160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ead2b-9397-46ae-b56c-2e90ba42811d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.494446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ead2b-9397-46ae-b56c-2e90ba42811d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.494752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ead2b-9397-46ae-b56c-2e90ba42811d admin admin] PATH_INFO: `/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.495974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ead2b-9397-46ae-b56c-2e90ba42811d admin admin] RBAC: Authorizing `identity:get_project(project_id=3d62f28d9f864b0ab7470e52d157f1c4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:19.521592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ead2b-9397-46ae-b56c-2e90ba42811d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:19.523130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 531/1062] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:19 2022] GET /identity/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:19.530122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:19.544436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b2b11-5a01-4029-be97-c3bfa8f17307 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:19.552514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:19.553419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:19.553892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:19.554365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:19.555689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=3d62f28d9f864b0ab7470e52d157f1c4, user.id=ecd38da316b44c33a55e78e597a54e29) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:19.556193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:19.581992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f3b15-cb09-4215-898c-5e0573defe51 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:19.588306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 532/1063] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:19 2022] GET /identity/v3/role_assignments?user.id=ecd38da316b44c33a55e78e597a54e29&scope.project.id=3d62f28d9f864b0ab7470e52d157f1c4&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:21.535517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ffa2-7e83-48db-9912-a882da2d03fb None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.536388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ffa2-7e83-48db-9912-a882da2d03fb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.536388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6ffa2-7e83-48db-9912-a882da2d03fb None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.539161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 532/1064] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:21.545491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.545952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.546051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.573499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:21.574645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:21.581683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 533/1065] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:21 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:21.604494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ffa2-7e83-48db-9912-a882da2d03fb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:21.624173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6ffa2-7e83-48db-9912-a882da2d03fb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:21.628448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:21.629167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.629458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.629738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.642493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:21.648759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:21.649876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 533/1066] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:21.656549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:21.665398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310760a3-74bb-4d8b-a81b-564d9fad55ad None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:21.670463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:21.671098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.671384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.671661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.672378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:21.672673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:21.697808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:21.707006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 534/1067] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:21.714021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:21.730965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1d9f-1347-4400-b756-9e044501176d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:21.737919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:21.739166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.739594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.740003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] PATH_INFO: `/v3/users/ecd38da316b44c33a55e78e597a54e29` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.741903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ecd38da316b44c33a55e78e597a54e29)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:21.769031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:21.770483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 534/1068] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:21 2022] GET /identity/v3/users/ecd38da316b44c33a55e78e597a54e29 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:21.776162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:21.786789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbb96d-a61f-4041-b85f-ce7f7531b94e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:21.792721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7b924-29f7-4dda-aa18-d43c9adadd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:21.793490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7b924-29f7-4dda-aa18-d43c9adadd61 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.793767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7b924-29f7-4dda-aa18-d43c9adadd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.794039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7b924-29f7-4dda-aa18-d43c9adadd61 admin admin] PATH_INFO: `/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.795353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7b924-29f7-4dda-aa18-d43c9adadd61 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d62f28d9f864b0ab7470e52d157f1c4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:21.820822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7b924-29f7-4dda-aa18-d43c9adadd61 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:21.822321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 535/1069] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:21 2022] GET /identity/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:21.828948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:21.842812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56232644-bf6a-4638-9f87-03d8b7d731f9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:21.848973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f3f45-4bee-46db-9cb3-08236e6eff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:21.849781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3f45-4bee-46db-9cb3-08236e6eff46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:21.850066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3f45-4bee-46db-9cb3-08236e6eff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:21.850346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3f45-4bee-46db-9cb3-08236e6eff46 admin admin] PATH_INFO: `/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4/users/ecd38da316b44c33a55e78e597a54e29/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:21.852593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f3f45-4bee-46db-9cb3-08236e6eff46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d62f28d9f864b0ab7470e52d157f1c4, user_id=ecd38da316b44c33a55e78e597a54e29, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:21.878514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f3f45-4bee-46db-9cb3-08236e6eff46 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:21.895019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 535/1070] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:34:21 2022] PUT /identity/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4/users/ecd38da316b44c33a55e78e597a54e29/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:34:23.865386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280f60-560b-487a-a588-d0139a1744a3 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:23.866281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280f60-560b-487a-a588-d0139a1744a3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:23.866281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa280f60-560b-487a-a588-d0139a1744a3 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:23.868934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 536/1071] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:23.874363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:23.874808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:23.874922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:23.898094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:23.899240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:23.969025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 536/1072] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:23 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:23.992059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280f60-560b-487a-a588-d0139a1744a3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:24.014643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa280f60-560b-487a-a588-d0139a1744a3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:24.022800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:24.023839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:24.024194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:24.024544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:24.038961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:24.045216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:24.046305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 537/1073] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:24.055873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:24.065863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3020f2-5575-4246-9cf1-eced3e4f0bca None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:24.071147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:24.071734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:24.072018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:24.072296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:24.073003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:24.073325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:24.098856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:24.107816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 537/1074] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:24.114155 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:24.130382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca581f5b-9f66-40fd-a91a-7617773409d3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:24.137979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:24.138783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:24.139062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:24.139340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] PATH_INFO: `/v3/users/ecd38da316b44c33a55e78e597a54e29` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:24.140563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] RBAC: Authorizing `identity:get_user(user_id=ecd38da316b44c33a55e78e597a54e29)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:24.166764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:24.168427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 538/1075] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:24 2022] GET /identity/v3/users/ecd38da316b44c33a55e78e597a54e29 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:24.177144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:24.191568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140ce9-15a9-4d7e-9070-4a0ef0394f92 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:24.199290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:24.199856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:24.200134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:24.200409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:24.208463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:24.233905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:24.243105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 538/1076] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:24 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:24.249638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:24.263658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b4120-f4b9-4ce9-8b6e-4ebb6a059116 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:24.269849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b283a1-938f-4bfb-a53e-992551aed3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:24.270662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b283a1-938f-4bfb-a53e-992551aed3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:24.270951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b283a1-938f-4bfb-a53e-992551aed3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:24.271232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b283a1-938f-4bfb-a53e-992551aed3d0 admin admin] PATH_INFO: `/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:24.272554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b283a1-938f-4bfb-a53e-992551aed3d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d62f28d9f864b0ab7470e52d157f1c4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:24.304413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b283a1-938f-4bfb-a53e-992551aed3d0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:24.305969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 539/1077] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:24 2022] GET /identity/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4 => generated 311 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:24.316106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:24.327777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d8adf-153d-43a5-9bd4-75182a0767ed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:24.333316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:24.333893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:24.334177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:24.334453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:24.335262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=3d62f28d9f864b0ab7470e52d157f1c4, user.id=ecd38da316b44c33a55e78e597a54e29) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:24.335567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:24.364975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc82068-8966-42b5-9910-c13ddd0475a8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:24.371320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 539/1078] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:24 2022] GET /identity/v3/role_assignments?user.id=ecd38da316b44c33a55e78e597a54e29&scope.project.id=3d62f28d9f864b0ab7470e52d157f1c4&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:26.395754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01f31-765e-4c60-ae78-7e5fbceeb258 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:26.396297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01f31-765e-4c60-ae78-7e5fbceeb258 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:26.396297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01f31-765e-4c60-ae78-7e5fbceeb258 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:26.397965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 540/1079] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:26.404691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:26.405425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:26.405566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:26.435112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:26.436252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:26.445470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 540/1080] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:26 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:26.469882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01f31-765e-4c60-ae78-7e5fbceeb258 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:26.487435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01f31-765e-4c60-ae78-7e5fbceeb258 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:26.492697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:26.493270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:26.493560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:26.493843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:26.502703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:26.528038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:26.537059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 541/1081] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:26 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:26.545010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:26.554119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7511e-73c4-44ee-af8f-1ad43440a840 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:26.559113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:26.559835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:26.560121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:26.560399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:26.569062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:26.595176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:26.609776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-3b137b3a-82e9-4bfc-9e5d-faf2098fa73d admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 28 18:34:26.610889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 541/1082] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:34:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:26.616976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:26.626136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b18c-da50-4b91-86f2-ee5392c6d21b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:26.631493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:26.632068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:26.632357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:26.632632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:26.633320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:26.633615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:26.658943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec87a0f-ca5c-4ac7-bc86-0975af83a6a3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:26.667420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 542/1083] 10.222.0.18 () {56 vars in 1136 bytes} [Mon Feb 28 18:34:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:28.616513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1db4-191c-444b-808c-3e439e57cfc8 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:28.617135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1db4-191c-444b-808c-3e439e57cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:28.617135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1db4-191c-444b-808c-3e439e57cfc8 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:28.619698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 542/1084] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:28.628514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bef51-eaa3-4ccc-a417-482a0233f87b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:28.628901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bef51-eaa3-4ccc-a417-482a0233f87b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:28.629153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bef51-eaa3-4ccc-a417-482a0233f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:28.655156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f26bef51-eaa3-4ccc-a417-482a0233f87b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:28.656285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f26bef51-eaa3-4ccc-a417-482a0233f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:28.664318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 543/1085] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:28 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:28.687835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a1db4-191c-444b-808c-3e439e57cfc8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:28.702607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a1db4-191c-444b-808c-3e439e57cfc8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:28.708619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:28.709192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:28.709470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:28.709741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:28.710430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:28.736012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:34:28.736012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:34:28.736012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:34:28.736909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a83810-cb6a-4e18-b1b7-699398b41f30 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:28.760717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 543/1086] 10.222.0.18 () {60 vars in 1159 bytes} [Mon Feb 28 18:34:28 2022] POST /identity/v3/domains => generated 267 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:30.739693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e3d30-eda9-4f59-b081-8888bbcb68ef None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.740577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e3d30-eda9-4f59-b081-8888bbcb68ef None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.740577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e3d30-eda9-4f59-b081-8888bbcb68ef None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.743324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 544/1087] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:30.748775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.749188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.749291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.774188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:30.775350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:30.844138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 544/1088] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:30 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:30.873356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e3d30-eda9-4f59-b081-8888bbcb68ef None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.891789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e3d30-eda9-4f59-b081-8888bbcb68ef None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.897120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dd53e-dc48-4913-8631-6106cee3d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.897906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd53e-dc48-4913-8631-6106cee3d59d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.898198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd53e-dc48-4913-8631-6106cee3d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.898474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dd53e-dc48-4913-8631-6106cee3d59d admin admin] PATH_INFO: `/v3/domains/f5e03732683e44cb860d0e82e3db3468` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.911728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd53e-dc48-4913-8631-6106cee3d59d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=f5e03732683e44cb860d0e82e3db3468)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:30.937427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dd53e-dc48-4913-8631-6106cee3d59d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:30.938918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 545/1089] 10.222.0.18 () {56 vars in 1204 bytes} [Mon Feb 28 18:34:30 2022] GET /identity/v3/domains/f5e03732683e44cb860d0e82e3db3468 => generated 267 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:30.948049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:30.957356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c720fa-7c06-4b19-82e5-4e90ee19b26b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:30.963860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee152d5-e729-463f-822d-044d82d43d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:30.964339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee152d5-e729-463f-822d-044d82d43d66 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:30.964623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee152d5-e729-463f-822d-044d82d43d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:30.964897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee152d5-e729-463f-822d-044d82d43d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:30.965547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee152d5-e729-463f-822d-044d82d43d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:30.990920 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee152d5-e729-463f-822d-044d82d43d66 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:31.024853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 545/1090] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:34:30 2022] POST /identity/v3/projects => generated 361 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:34:32.999111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fced5e-1479-4c97-9b17-222576e64239 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:32.999995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fced5e-1479-4c97-9b17-222576e64239 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:32.999995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fced5e-1479-4c97-9b17-222576e64239 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:33.002868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 546/1091] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:33.008297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:33.008704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:33.008831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:33.037437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:33.038680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:33.112618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 546/1092] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:33 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:33.137519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fced5e-1479-4c97-9b17-222576e64239 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:33.151727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fced5e-1479-4c97-9b17-222576e64239 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:33.157169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8728a0-3123-4410-b037-ab7b1ba76d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:33.157953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8728a0-3123-4410-b037-ab7b1ba76d9b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:33.158265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8728a0-3123-4410-b037-ab7b1ba76d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:33.158545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8728a0-3123-4410-b037-ab7b1ba76d9b admin admin] PATH_INFO: `/v3/domains/f5e03732683e44cb860d0e82e3db3468` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:33.159799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8728a0-3123-4410-b037-ab7b1ba76d9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=f5e03732683e44cb860d0e82e3db3468)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:33.185378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8728a0-3123-4410-b037-ab7b1ba76d9b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:33.186935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 547/1093] 10.222.0.18 () {56 vars in 1204 bytes} [Mon Feb 28 18:34:33 2022] GET /identity/v3/domains/f5e03732683e44cb860d0e82e3db3468 => generated 267 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:33.192909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:33.201894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8daa4-4e8a-44d1-9800-d9fdac541c32 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:33.206440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdfaad-a301-4408-92d7-b8fd1b1c43fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:33.207068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfaad-a301-4408-92d7-b8fd1b1c43fc admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:33.207356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfaad-a301-4408-92d7-b8fd1b1c43fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:33.207636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfaad-a301-4408-92d7-b8fd1b1c43fc admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:33.208293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdfaad-a301-4408-92d7-b8fd1b1c43fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:33.233973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdfaad-a301-4408-92d7-b8fd1b1c43fc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:33.262610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 547/1094] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:34:33 2022] POST /identity/v3/users => generated 311 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:34:35.278856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757195-9fab-4874-b767-bad4abfd54cd None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.279372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757195-9fab-4874-b767-bad4abfd54cd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.279372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e757195-9fab-4874-b767-bad4abfd54cd None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.281127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 548/1095] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:35.286607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.287040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.287132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.311201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:35.312323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:35.320118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 548/1096] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:35 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:35.343497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e757195-9fab-4874-b767-bad4abfd54cd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.360805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e757195-9fab-4874-b767-bad4abfd54cd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.365612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.366330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.366623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.366935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.379503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:35.385848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:35.388524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 549/1097] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:35.392884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.402138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456bf08-e85e-46fc-a888-371b18c69da9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.407470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.408064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.408350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.408631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.409346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:35.409654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:35.434738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.443971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 549/1098] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:35.450392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.467565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba247b7-0e6f-40b2-91c4-2019039f1ff9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.476360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.477573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.477994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.478402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] PATH_INFO: `/v3/users/2d9eb26040994fbba8a672ae5615113d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.498166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] RBAC: Authorizing `identity:get_user(user_id=2d9eb26040994fbba8a672ae5615113d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:35.524024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.525551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 550/1099] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/users/2d9eb26040994fbba8a672ae5615113d => generated 311 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:35.534833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.547154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aea46-235b-47f7-96df-6554fe1c4886 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.553223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.553794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.554081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.554355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.562479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:35.587981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.597417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 550/1100] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:35.604175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.620042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff040233-36a3-4129-9176-1b002582e594 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.629012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63222-1e81-4302-bba8-ed8030b614c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.630265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63222-1e81-4302-bba8-ed8030b614c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.630792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63222-1e81-4302-bba8-ed8030b614c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.631262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63222-1e81-4302-bba8-ed8030b614c5 admin admin] PATH_INFO: `/v3/projects/278f632221c040889e0fab7d5ad547b7` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.633281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db63222-1e81-4302-bba8-ed8030b614c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=278f632221c040889e0fab7d5ad547b7)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:35.659916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db63222-1e81-4302-bba8-ed8030b614c5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.661415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 551/1101] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/projects/278f632221c040889e0fab7d5ad547b7 => generated 361 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:35.669344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:35.677962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a46b6f-dcb6-4edc-bae6-2420f5f4c7f2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:35.684015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:35.684585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:35.684868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:35.685142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:35.685915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=278f632221c040889e0fab7d5ad547b7, user.id=2d9eb26040994fbba8a672ae5615113d) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:35.686216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:35.712435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece496cb-4653-4aa6-8fad-0a8477632af9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:35.719250 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 551/1102] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:35 2022] GET /identity/v3/role_assignments?user.id=2d9eb26040994fbba8a672ae5615113d&scope.project.id=278f632221c040889e0fab7d5ad547b7&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:37.658753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b620677-6e22-476c-a479-fd6d6e6b6306 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.659304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b620677-6e22-476c-a479-fd6d6e6b6306 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.659304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b620677-6e22-476c-a479-fd6d6e6b6306 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.661009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 552/1103] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:37.667635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.668346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.668559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.702970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:37.704122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:37.712528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 552/1104] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:37 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:37.735527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b620677-6e22-476c-a479-fd6d6e6b6306 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:37.756834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b620677-6e22-476c-a479-fd6d6e6b6306 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:37.763632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:37.764341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.764627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.764906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.776647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:37.782854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:37.783931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 553/1105] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:37.789942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:37.798743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45434b-82d3-47f4-9227-47a609b2a6fd None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:37.804179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:37.804771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.805059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.805335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.806055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:37.806357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:37.834275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:37.844886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 553/1106] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:37.851787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:37.863572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf00e07-5aec-402f-949d-d176a9544619 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:37.869083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:37.869876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.870162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.870447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] PATH_INFO: `/v3/users/2d9eb26040994fbba8a672ae5615113d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.871728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] RBAC: Authorizing `identity:get_user(user_id=2d9eb26040994fbba8a672ae5615113d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:37.897301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:37.898785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 554/1107] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:37 2022] GET /identity/v3/users/2d9eb26040994fbba8a672ae5615113d => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:37.907879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:37.920869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a3592-35c9-44f2-a12c-3058ed5d60e7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:37.926909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffa42a-4590-4f75-89e9-ce507799da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:37.927687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffa42a-4590-4f75-89e9-ce507799da01 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.927975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffa42a-4590-4f75-89e9-ce507799da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.928253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffa42a-4590-4f75-89e9-ce507799da01 admin admin] PATH_INFO: `/v3/projects/278f632221c040889e0fab7d5ad547b7` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.929549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffa42a-4590-4f75-89e9-ce507799da01 admin admin] RBAC: Authorizing `identity:get_project(project_id=278f632221c040889e0fab7d5ad547b7)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:37.955163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffa42a-4590-4f75-89e9-ce507799da01 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:37.956686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 554/1108] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:37 2022] GET /identity/v3/projects/278f632221c040889e0fab7d5ad547b7 => generated 361 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:37.963696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:37.973586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd8e8-8ed0-498d-b7d1-2a15ce632d1f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:37.980083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5160-ba86-4e44-9a1b-069da2837f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:37.980883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5160-ba86-4e44-9a1b-069da2837f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:37.981164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5160-ba86-4e44-9a1b-069da2837f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:37.981444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5160-ba86-4e44-9a1b-069da2837f6f admin admin] PATH_INFO: `/v3/projects/278f632221c040889e0fab7d5ad547b7/users/2d9eb26040994fbba8a672ae5615113d/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:37.983503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e5160-ba86-4e44-9a1b-069da2837f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=278f632221c040889e0fab7d5ad547b7, user_id=2d9eb26040994fbba8a672ae5615113d, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:38.009936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e5160-ba86-4e44-9a1b-069da2837f6f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:38.027535 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 555/1109] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:34:37 2022] PUT /identity/v3/projects/278f632221c040889e0fab7d5ad547b7/users/2d9eb26040994fbba8a672ae5615113d/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:34:39.989259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b06f-afe7-47fe-9ec7-1078898cc980 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:39.989815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b06f-afe7-47fe-9ec7-1078898cc980 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:39.989815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b06f-afe7-47fe-9ec7-1078898cc980 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:39.991533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 555/1110] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:34:39.997702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:39.998131 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:39.998323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.026243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:34:40.027430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:34:40.095617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 556/1111] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:34:39 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:34:40.119526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b06f-afe7-47fe-9ec7-1078898cc980 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.138702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b06f-afe7-47fe-9ec7-1078898cc980 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.144516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.145221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.145502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.145773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.158420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:34:40.164637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:34:40.165714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 556/1112] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:34:40.171732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.180473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0022caa-20cc-46a8-a206-4f3bc7de0f21 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.185528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.186189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.186545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.186923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.187686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:40.188049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:40.213808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:40.223676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 557/1113] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:40.234606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.248394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a6bfe-3137-486b-9527-4966fec52706 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.252818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.253604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.253890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.254162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] PATH_INFO: `/v3/users/2d9eb26040994fbba8a672ae5615113d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.255383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2d9eb26040994fbba8a672ae5615113d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:40.281238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:40.282728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 557/1114] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:34:40 2022] GET /identity/v3/users/2d9eb26040994fbba8a672ae5615113d => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:40.288755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.298880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeabb2-0164-4837-8358-5b3d51c902c5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.304105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.304666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.304957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.305227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.313046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:40.338819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:40.347677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 558/1115] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:34:40 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:34:40.354133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.369875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bf4d4-9fbf-45c5-ab7b-24d399c44fb6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.375499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95904-a3dd-4c2e-9044-3ab6c1fe057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.376271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95904-a3dd-4c2e-9044-3ab6c1fe057e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.376561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95904-a3dd-4c2e-9044-3ab6c1fe057e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.376841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95904-a3dd-4c2e-9044-3ab6c1fe057e admin admin] PATH_INFO: `/v3/projects/278f632221c040889e0fab7d5ad547b7` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.378035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe95904-a3dd-4c2e-9044-3ab6c1fe057e admin admin] RBAC: Authorizing `identity:get_project(project_id=278f632221c040889e0fab7d5ad547b7)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:40.403767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe95904-a3dd-4c2e-9044-3ab6c1fe057e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:40.405273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 558/1116] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:34:40 2022] GET /identity/v3/projects/278f632221c040889e0fab7d5ad547b7 => generated 361 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:34:40.414322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:34:40.428880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11936350-dff3-47e9-9bf8-66758103c986 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:34:40.435485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:34:40.436030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:34:40.436331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:34:40.436602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:34:40.437382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=278f632221c040889e0fab7d5ad547b7, user.id=2d9eb26040994fbba8a672ae5615113d) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:34:40.437677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:34:40.463672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f04a36-80c0-4a8e-9fa0-4295eafb8c4b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:34:40.469856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 559/1117] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:34:40 2022] GET /identity/v3/role_assignments?user.id=2d9eb26040994fbba8a672ae5615113d&scope.project.id=278f632221c040889e0fab7d5ad547b7&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:14.621377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb7d5-b772-4504-9d28-8cd2f7bdebc0 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.622304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb7d5-b772-4504-9d28-8cd2f7bdebc0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.622304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebb7d5-b772-4504-9d28-8cd2f7bdebc0 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.624930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 559/1118] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:14.630799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.631241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.631349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.654469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:14.655616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:14.666519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 560/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:14 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:14.690498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb7d5-b772-4504-9d28-8cd2f7bdebc0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.703816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebb7d5-b772-4504-9d28-8cd2f7bdebc0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.708899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.709617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.710212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.710485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.725297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:14.750159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.768068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:14.769168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 560/1120] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:14.776218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.788017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838c8b5-c58d-4070-a5c3-4cf326ad0c18 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.794288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.794927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.795210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.795487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.796175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:14.796473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:14.821883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045a067-dca0-4218-b6a2-ddfc362e595e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.837299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 561/1121] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:14.843957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:14.860258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcca748-f7d6-4078-b3a4-f34ea48eaecb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:14.868177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc61b2c-9f1a-4cd8-86fb-f7834819a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:14.869098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc61b2c-9f1a-4cd8-86fb-f7834819a9dc admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:14.869568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc61b2c-9f1a-4cd8-86fb-f7834819a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:14.869994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc61b2c-9f1a-4cd8-86fb-f7834819a9dc admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:14.871127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc61b2c-9f1a-4cd8-86fb-f7834819a9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:14.899341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc61b2c-9f1a-4cd8-86fb-f7834819a9dc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:14.925485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 561/1122] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Feb 28 18:36:14 2022] POST /identity/v3/users => generated 251 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:36:16.937023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552de3-a085-4ef4-8dc0-86c6de2292a6 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:16.937601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552de3-a085-4ef4-8dc0-86c6de2292a6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:16.937601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06552de3-a085-4ef4-8dc0-86c6de2292a6 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:16.939825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 562/1123] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:16.946032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:16.946816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:16.946947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:16.978948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:16.980106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:16.989346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 562/1124] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:16 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:17.012391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06552de3-a085-4ef4-8dc0-86c6de2292a6 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.027516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06552de3-a085-4ef4-8dc0-86c6de2292a6 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.033779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.034481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.034789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.035067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.049168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:36:17.056594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:36:17.057870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 563/1125] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:17.066485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.075751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8b441-e029-42b5-902a-090e69c61fab None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.081446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.082219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.082571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.082860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.083775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:17.084255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.118261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.131888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 563/1126] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:17.138274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.150137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86081db8-dfe8-4619-bed8-4614bc706b08 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.155151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.155899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.156258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.156534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.168506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.193984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.212357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:17.213252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 564/1127] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:17.219125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.228736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed59ae-b9a7-4b46-92e0-c56565413924 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.233910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.234496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.234811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.235094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.235900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:17.236175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.261235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.274849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 564/1128] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:17.281132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.295024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039643e-4426-491e-8bd3-cf1281e3768e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.302094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.302826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.303109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.303380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.316934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.342576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.361029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:36:17.362059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 565/1129] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:17.371462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.387272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4255956-a72c-49ff-9e24-8910374b905c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.394953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.395542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.395827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.396106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.396899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:17.397201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.422391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.452572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 565/1130] 10.222.0.18 () {56 vars in 1164 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:17.458675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.469870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c1ff-1310-4b76-a281-8a6cd4465df2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.476000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.476561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.476844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.477808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.486673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.511668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.521745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 566/1131] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:17.530974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.541155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20002e30-65ab-437a-9c73-61435f30ed7d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.546589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.547344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.547725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.548000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.560084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.585706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.603889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:17.604969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 566/1132] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:17.611570 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.625695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e978d-c3a3-4ee7-a984-16b4fab9599d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.632010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.632594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.632883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.633159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.633848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:17.634143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.659217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.673307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 567/1133] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:17.678980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.688479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037267b7-d918-4ef0-91dd-30e36e56abc1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.693220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.693926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.694209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.694464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.704386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.729883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.744143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:17.745209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 567/1134] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:17.752185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.768304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc37d6-94c7-472d-9918-f872b396b36e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.777397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.778326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.778918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.779386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.780628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:17.781097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.806758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e4a1e-fd05-40c1-8709-be775b6df88e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.820662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 568/1135] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:17.831437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:17.847550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237829d6-d6a9-4c75-a89e-8bde0fd28afb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:17.853739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:17.854316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:17.854593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:17.854906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:17.855697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=428c5ed13bcf410490fbac7a992a86ed) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:17.856003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:17.881370 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f401bf-b106-4234-afb3-6517944442c7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:17.887243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 568/1136] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:17 2022] GET /identity/v3/role_assignments?user.id=428c5ed13bcf410490fbac7a992a86ed&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 259 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:19.921747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4d13-105b-44ac-8310-86a3adf8390c None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.922310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4d13-105b-44ac-8310-86a3adf8390c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.922310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b4d13-105b-44ac-8310-86a3adf8390c None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.924953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 569/1137] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:19.931469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:19.931927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:19.932149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:19.964421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:19.966011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:19.976937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 569/1138] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:19 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:20.004341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b4d13-105b-44ac-8310-86a3adf8390c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.019939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b4d13-105b-44ac-8310-86a3adf8390c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.024540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.025261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.025543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.025814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.037897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:36:20.044580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:36:20.045701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 570/1139] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:20.052404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.064841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72451d97-1e52-4172-b35c-ce2bccee8187 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.075010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.075622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.075859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.076225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.077216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:20.077556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.112764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.125106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 570/1140] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:20.132136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.143020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bf0e-3c15-4d18-8172-4877d01f443d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.147649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.148466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.148774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.149040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.160523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.186436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.204731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:20.205869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 571/1141] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:20.212265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.223695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137dbd-0612-4b0c-8255-0c1345af3cb2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.231685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.232571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.232991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.233403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.234489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:20.235000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.260694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.275103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 571/1142] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:20.284917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.299660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cadc69-ed1c-44d6-8385-f05be7a520fc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.305095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.305824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.306110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.306387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.319641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.345707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.364827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:36:20.365959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 572/1143] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:20.373003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.385204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde57e95-ed4b-41ca-80a6-fe3e97f74ab7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.392583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.393279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.393562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.393840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.394731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:20.395031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.420489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.451820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 572/1144] 10.222.0.18 () {56 vars in 1164 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:20.461883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.475435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d764-db89-41d7-a470-403771d4dc4e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.484292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.485505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.485992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.486347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.499945 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.525197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.542984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:20.544068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 573/1145] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:20.550894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.565670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d680d-4cd7-42b8-8b6a-b2fe9bffd17f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.571775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.572371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.572660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.572943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.573637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:20.573935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.599527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.614524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 573/1146] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:20.620433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.630541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dbe7a-1323-412a-bc88-b40cfdd3aae4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.635831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.636537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.636817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.637098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.649860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.675328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.689606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:20.690708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 574/1147] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:20.697576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.714009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b231-af4b-4a9f-8b72-f672e0fbb8b5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.721588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.722173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.722458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.722767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.723527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:20.723829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.749336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4971f-1f5c-43cb-b709-4542aae00218 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.764118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 574/1148] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:20.774148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:20.784302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11045-e2f3-474a-b2b7-a19011573bfd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:20.789460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa95c0-2cdd-46ad-babd-7551c09d54bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:20.790275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa95c0-2cdd-46ad-babd-7551c09d54bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:20.790584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa95c0-2cdd-46ad-babd-7551c09d54bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:20.790869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa95c0-2cdd-46ad-babd-7551c09d54bb admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/428c5ed13bcf410490fbac7a992a86ed/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:20.812563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa95c0-2cdd-46ad-babd-7551c09d54bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=428c5ed13bcf410490fbac7a992a86ed, role_id=7b370ec0f1ee43f7ac5a0c4cba3c2548)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:20.838920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa95c0-2cdd-46ad-babd-7551c09d54bb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:20.856514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 575/1149] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:36:20 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/428c5ed13bcf410490fbac7a992a86ed/roles/7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:36:22.812382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c429-4739-421d-bd8c-35197965e20d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:22.813020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c429-4739-421d-bd8c-35197965e20d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:22.813020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c429-4739-421d-bd8c-35197965e20d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:22.814710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 575/1150] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:22.821005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:22.821705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:22.821852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:22.853631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:22.854816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:22.919713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 576/1151] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:22 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:22.942502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c429-4739-421d-bd8c-35197965e20d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:22.956566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c429-4739-421d-bd8c-35197965e20d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:22.962190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:22.962932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:22.963217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:22.963490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:22.975876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:36:22.982085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 18:36:22.983254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 576/1152] 10.222.0.18 () {56 vars in 1123 bytes} [Mon Feb 28 18:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:22.989950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.002772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e6986-21a7-453e-9c4b-9294767b9694 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.008244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.008835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.009125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.009403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.010124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:23.010424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.035498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.044309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 577/1153] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Feb 28 18:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:23.052667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.064033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75ce9-e56a-41a9-ba38-7f67b2d8b038 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.068771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.069508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.069795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.070072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.082031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.107773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.125721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:23.127125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 577/1154] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:23.133513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.143868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5144d-12d0-47ba-b189-71bc58eb4825 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.148721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.149308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.149592 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.149865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.150547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:23.150872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.176009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.188853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 578/1155] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:23.194652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.204406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd74b-5301-4801-8487-65d260bd6156 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.208734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.209464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.209753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.210359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.223394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.249138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.267994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:36:23.269093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 578/1156] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:23.275793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.291374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6429-72a5-454c-ba7b-16d6d094ce08 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.298768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.299360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.299646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.299927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.300723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:23.301025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.326550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.356771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 579/1157] 10.222.0.18 () {56 vars in 1164 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:23.364252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.374072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93691d-6876-4653-b259-babf4cc6d68e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.379640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.380208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.380495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.380771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.388891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.414258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.423887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 579/1158] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:23.430222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.445746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dbb87-2ae9-41c2-9e66-5934a996e1bb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.454684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.455421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.455708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.455983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.473754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.499114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.516887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:23.518118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 580/1159] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:23.527617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.538261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618f29c-bb5c-44ce-aa02-859e094a76ee admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.543962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.544543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.544836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.545116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.545804 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:23.546102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.571388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.586067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 580/1160] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:23.592403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.603814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35963-9ea9-4f3d-9352-cb5d6d1cc65f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.609871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.611003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.611271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.611562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.621646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.647979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.662404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:23.663478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 581/1161] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:23.672778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.688485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e67cd2-d2de-4873-bbfa-c01d17716e93 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.694965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.695544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.695834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.696112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.696859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:23.697159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.723220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b709f9-4e17-4ae4-aa57-ef8c4f315d63 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.737964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 581/1162] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:23.744582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:23.759619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d398-4702-4264-9756-f027189cbdec admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:23.764533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:23.765095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:23.765377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:23.765655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:23.766431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] RBAC: Adding query filter params (role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=428c5ed13bcf410490fbac7a992a86ed) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:23.766872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:23.792483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8d62-ab55-42a6-9b3d-4a3b0d8e00b8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:23.799411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 582/1163] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:23 2022] GET /identity/v3/role_assignments?user.id=428c5ed13bcf410490fbac7a992a86ed&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=7b370ec0f1ee43f7ac5a0c4cba3c2548 => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:25.903816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9edc-1ed9-488b-9b3d-b6fc64a6dd1a None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:25.904837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9edc-1ed9-488b-9b3d-b6fc64a6dd1a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:25.904837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9edc-1ed9-488b-9b3d-b6fc64a6dd1a None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:25.907588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 582/1164] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:25.913524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:25.913983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:25.914107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:25.946363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:25.947542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:25.955197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 583/1165] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:25 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:25.978782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9edc-1ed9-488b-9b3d-b6fc64a6dd1a None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:25.999590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9edc-1ed9-488b-9b3d-b6fc64a6dd1a None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.006024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.006760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.007041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.007311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.019170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:36:26.025298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:26.026381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 583/1166] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:26.032508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.041123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8c9c-6633-4eb9-853f-8b8095deeaa2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.045667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.046260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.046581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.046876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.047640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:26.047965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.073229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.082139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 584/1167] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.089115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.101429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f493d3-fcec-4beb-8a17-b263edbc437e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.107472 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.108170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.108447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.108719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.120520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.145880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.164255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:26.165232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 584/1168] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:26.174386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.184178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85d14-52d7-43a3-8b0b-6b4b77fc40b6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.189268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.189853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.190139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.190417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.191138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:26.191432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.217472 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.236719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 585/1169] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:26.243433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.258997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b83027-95e5-4aa6-8371-dfc2cd54801d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.267558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.268282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.268564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.268886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.281994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.307852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.326354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:36:26.327435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 585/1170] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:26.337975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.354626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b51d38-fe37-4c2e-bec5-08c47f38b033 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.362465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.363097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.363380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.363657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.364455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:26.364755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.390001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.421930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 586/1171] 10.222.0.18 () {56 vars in 1164 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.429392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.444980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6cbf6-8e0a-4cdd-8811-319f92c24a12 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.453616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.454596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.454864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.455135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.463518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.488562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.498204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 586/1172] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:26.508369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.522863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f710c-0d71-4441-90bd-d515f0b4c479 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.528348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.529073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.529356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.529629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.543443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.572420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.590257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:26.591389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 587/1173] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:26.598124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.607661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad84e-d9db-4947-b4b7-468d9f78c5c4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.614217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.614837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.615117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.615389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.616070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:26.616360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.642431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.655975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 587/1174] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.662865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.678683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025ec5-226f-49b9-94c2-0de626985b3d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.687568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.688919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.689317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.689446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.701159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.731550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.745913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:26.747041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 588/1175] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:26.755234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.765628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387ec80-7409-499d-bf5f-a77d5c65246e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.772232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.772810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.773089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.773360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.774101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:26.774395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.800462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d04d2-4bca-468a-b2fd-e14ad18e9bea admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.813448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 588/1176] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:26.820502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:26.837690 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d647-af9e-4dbc-8134-abe65287bbba admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:26.846279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:26.846878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:26.847153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:26.847457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:26.848242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=428c5ed13bcf410490fbac7a992a86ed) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:26.848542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:26.874278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9113f-e81f-4baa-bcb1-f970d45e42b8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:26.880492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 589/1177] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:26 2022] GET /identity/v3/role_assignments?user.id=428c5ed13bcf410490fbac7a992a86ed&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:28.869530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c03cd7-1e91-4d06-918d-92be3164dcd5 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:28.870091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c03cd7-1e91-4d06-918d-92be3164dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:28.870091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c03cd7-1e91-4d06-918d-92be3164dcd5 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:28.871777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 589/1178] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:28.878076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:28.878491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:28.878648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:28.913867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:28.915052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:28.924432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 590/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:28 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:28.947228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c03cd7-1e91-4d06-918d-92be3164dcd5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:28.968798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c03cd7-1e91-4d06-918d-92be3164dcd5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:28.975124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:28.975834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:28.976113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:28.976389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:28.988937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:36:28.995209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:28.996293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 590/1180] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:29.002380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.011780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e108fe4-9ee6-4595-9f2f-e34e6bdaab5d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.016858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.017546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.017835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.018113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.018874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:29.019180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.044162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.052939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 591/1181] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:29.060933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.071193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a6978-cfea-4bca-8724-ca84a348718b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.075947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.076620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.076929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.077209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.089148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.114504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.133033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:29.134026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 591/1182] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:29.143767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.159146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7944d-b013-4b02-bd53-cfaac7349f22 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.166931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.167516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.167798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.168079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.168760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:29.169056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.194232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.209665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 592/1183] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:29.215887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.225699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b4b4a-a371-4577-91a2-dc3b05d8a25a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.231051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.231780 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.232070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.232351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.245096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.270860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.289327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:36:29.290390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 592/1184] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:29.299194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.310510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a612-3833-4833-be02-40a05d4ead19 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.319925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.320864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.321330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.321786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.323139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:29.323628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.352243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.383261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 593/1185] 10.222.0.18 () {56 vars in 1164 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:29.392308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.408595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d978d8-f93e-4252-98e0-c52d6d3a0ead admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.416452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.417512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.417935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.418373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.433118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.458256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.476318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:29.477377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 593/1186] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:29.485882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.495977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d85a7-da31-4f07-a8aa-5d5822b8cd0b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.500950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.501591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.501862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.502149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.502866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:29.503166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.528414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.542408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 594/1187] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:29.551554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.565908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e9013-5fa2-4be4-a6ec-3ea525d06ac9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.570888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.571600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.571854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.572146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.582004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.607926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.621860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:29.622949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 594/1188] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:29.629366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.645524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb6500-abfe-4e29-a8eb-bcffbbdb2777 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.653656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.654601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.655108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.655576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.656783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:29.657281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.682888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bf532-9db3-4556-a26f-bb0893e8ad11 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.696469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 595/1189] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:29.705377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:29.721125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0be1f-c08f-4d11-be4c-0d3b9305e163 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:29.727037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02021d30-3ee5-4bd3-ac6c-d7abaea7dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:29.727922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021d30-3ee5-4bd3-ac6c-d7abaea7dcda admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:29.728199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021d30-3ee5-4bd3-ac6c-d7abaea7dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:29.728480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021d30-3ee5-4bd3-ac6c-d7abaea7dcda admin admin] PATH_INFO: `/v3/projects/425465b255334cc286e615b5dc15c6e1/users/428c5ed13bcf410490fbac7a992a86ed/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:29.730728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02021d30-3ee5-4bd3-ac6c-d7abaea7dcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=425465b255334cc286e615b5dc15c6e1, user_id=428c5ed13bcf410490fbac7a992a86ed, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:29.757077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02021d30-3ee5-4bd3-ac6c-d7abaea7dcda admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:29.778464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 595/1190] 10.222.0.18 () {58 vars in 1460 bytes} [Mon Feb 28 18:36:29 2022] PUT /identity/v3/projects/425465b255334cc286e615b5dc15c6e1/users/428c5ed13bcf410490fbac7a992a86ed/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:36:31.724996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4011c3-f278-43fc-82df-82cdaa1ac307 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:31.725553 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4011c3-f278-43fc-82df-82cdaa1ac307 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:31.725553 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4011c3-f278-43fc-82df-82cdaa1ac307 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:31.727288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 596/1191] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:31.733470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:31.734193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:31.734420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:31.759189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:31.760306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:31.830519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 596/1192] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:31 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:31.862889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4011c3-f278-43fc-82df-82cdaa1ac307 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:31.877511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4011c3-f278-43fc-82df-82cdaa1ac307 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:31.885043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:31.886054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:31.886403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:31.886797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:31.905714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Feb 28 18:36:31.912818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 18:36:31.913924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 597/1193] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Feb 28 18:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:31.920705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:31.933872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c8cb-bbfd-488c-b75d-8435624512e9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:31.939816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:31.940405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:31.940684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:31.940953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:31.941662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:31.941955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:31.967570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:31.977348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 597/1194] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Feb 28 18:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:31.986161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.002406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1beb7a-aaad-45e2-b720-a0689e72b4f5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.008167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.008865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.009145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.009417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.022364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.047918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.065435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:32.066494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 598/1195] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:32.072897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.088400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065f2e8-9a5d-4e6f-b99a-69d67eea0101 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.095992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.096565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.096849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.097121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.097790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:32.098084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.123300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.139762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 598/1196] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:32.145434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.155177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b523bd5-4f98-4196-b317-f3637af0a2d8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.160677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.161388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.161674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.161955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.175192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.200556 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.218891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 18:36:32.220040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 599/1197] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 18:36:32.226987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.240021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807dac-1936-4459-b60a-b03fea9d13a5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.245350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.245946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.246232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.246506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.247341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:32.247616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.273108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.304177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 599/1198] 10.222.0.18 () {56 vars in 1164 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:32.313448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.329596 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ac4e9-c9ea-4692-b194-5da62917ccb5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.334811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.335705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.335993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.336269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.345115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.370585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.381814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 600/1199] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:36:32.391431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.401309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891254-e19c-4ba8-9677-e6e75ae81064 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.407844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.408264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.408543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.408818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.421913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.447479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.465327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 18:36:32.466399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 600/1200] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:32.473017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.486811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec9729-4926-4d95-ac3c-cca23a9f556c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.493076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.493597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.493880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.494156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.494871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:32.495165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.520588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.534742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 601/1201] 10.222.0.18 () {56 vars in 1130 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:32.543337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.558075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4cc1d-1097-4f88-84c1-ea305f187454 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.565299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.565995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.566282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.566577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.575689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.601626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.619409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING keystone.server.flask.application [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 18:36:32.620558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 601/1202] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:32.629085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.639422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9147d1-6812-4859-b2e0-6640133bb455 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.644694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.645270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.645557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.645835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.646586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:32.646910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.672285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bbf72-acfb-456a-96c9-6fb341b0e7ce admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.685325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 602/1203] 10.222.0.18 () {56 vars in 1169 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:32.692302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:32.708017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656366-9283-4caa-a18d-616d92b84e47 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:32.717298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:32.718217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:32.718809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:32.719218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:32.720481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] RBAC: Adding query filter params (role.id=65cb1c6508a34cfb9eb638fffbccb91f, scope.project.id=425465b255334cc286e615b5dc15c6e1, user.id=428c5ed13bcf410490fbac7a992a86ed) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:32.720782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:32.746266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11d305-f52c-4eaa-b0d6-f37508ab03db admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:32.752427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 602/1204] 10.222.0.18 () {56 vars in 1395 bytes} [Mon Feb 28 18:36:32 2022] GET /identity/v3/role_assignments?user.id=428c5ed13bcf410490fbac7a992a86ed&scope.project.id=425465b255334cc286e615b5dc15c6e1&role.id=65cb1c6508a34cfb9eb638fffbccb91f => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:34.742071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9987c-1f95-4111-93a9-72c8f76f3897 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:34.742994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9987c-1f95-4111-93a9-72c8f76f3897 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:34.742994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9987c-1f95-4111-93a9-72c8f76f3897 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:34.745637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 603/1205] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:34.753824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:34.754268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:34.754357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:34.778109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:34.779284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:34.787589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 603/1206] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:34 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:36:34.809796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9987c-1f95-4111-93a9-72c8f76f3897 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:34.824974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9987c-1f95-4111-93a9-72c8f76f3897 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:34.830845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:34.831616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:34.831902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:34.832179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:34.832807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:34.858413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:34.869762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 18:36:34.870853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 604/1207] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:36:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:34.879221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:34.889562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e719d-cc48-4db3-921c-bc2a9d8f8742 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:34.898257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:34.899178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:34.899571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:34.899959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:34.900943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:34.901307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:34.931255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770ae24-fd37-4ff9-9596-c908dd4f6e24 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:34.938063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 604/1208] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Feb 28 18:36:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:34.944158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:34.953491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ffaf-8989-4183-a95d-2361a9eb7c8c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:34.958216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:34.958836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:34.959121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:34.959399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] PATH_INFO: `/v3/services` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:34.960077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:34.960712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:34.985765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97646-f2d0-4e72-80b3-058f16fc4306 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:34.990920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 605/1209] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Feb 28 18:36:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:36.954266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c442-edac-4cba-a195-0e55b3ef4fca None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:36.954889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c442-edac-4cba-a195-0e55b3ef4fca None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:36.954889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c442-edac-4cba-a195-0e55b3ef4fca None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:36.956781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 605/1210] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:36.963518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dd31-b174-4f32-b5eb-1653dd33c9b5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:36.964297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dd31-b174-4f32-b5eb-1653dd33c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:36.964449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25dd31-b174-4f32-b5eb-1653dd33c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:36.997928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7f25dd31-b174-4f32-b5eb-1653dd33c9b5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:36.999113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7f25dd31-b174-4f32-b5eb-1653dd33c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:37.007913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 606/1211] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:36 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:37.030938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c442-edac-4cba-a195-0e55b3ef4fca None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:37.045822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c442-edac-4cba-a195-0e55b3ef4fca None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:37.053898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3abf22-d344-4198-b3c2-2f951cf9acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:37.054775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3abf22-d344-4198-b3c2-2f951cf9acb9 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:37.055179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3abf22-d344-4198-b3c2-2f951cf9acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:37.055585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3abf22-d344-4198-b3c2-2f951cf9acb9 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:37.056634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3abf22-d344-4198-b3c2-2f951cf9acb9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:37.084663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3abf22-d344-4198-b3c2-2f951cf9acb9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:37.100056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 606/1212] 10.222.0.18 () {60 vars in 1162 bytes} [Mon Feb 28 18:36:37 2022] POST /identity/v3/services => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:36:39.094821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990be43-b536-4d45-a269-c0c42f1ad36b None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:39.095733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990be43-b536-4d45-a269-c0c42f1ad36b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:39.095946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990be43-b536-4d45-a269-c0c42f1ad36b None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:39.098663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 607/1213] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:39.106402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:39.106892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:39.107000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:39.131367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:39.132498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:39.152406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 607/1214] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:39 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:36:39.174608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990be43-b536-4d45-a269-c0c42f1ad36b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:39.187875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990be43-b536-4d45-a269-c0c42f1ad36b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:39.193356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:39.194070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:39.194354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:39.194658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:39.195284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:39.221234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:39.232574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 18:36:39.233673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 608/1215] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:36:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:39.243303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:39.257478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41dae7-0bb2-4826-98c6-d29d49a1edf9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:39.266359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:39.267372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:39.267657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:39.267933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:39.268620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:39.268917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:39.293909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:39.299797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 608/1216] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Feb 28 18:36:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:36:39.309031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:39.320583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11036c-11de-46ea-bd5e-419301a4255c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:39.326844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:39.327423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:39.327700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:39.327972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:39.328711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] RBAC: Adding query filter params (interface=public, service_id=6d36172d56a7486582f4f449c9122394, region_id=RegionOne) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:39.329008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:39.354672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421d198-91b8-439c-8f43-bc9480f85a30 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:39.361015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 609/1217] 10.222.0.18 () {56 vars in 1272 bytes} [Mon Feb 28 18:36:39 2022] GET /identity/v3/endpoints?service_id=6d36172d56a7486582f4f449c9122394&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:39.367697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:39.381550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dee60-8aa1-4ae8-a914-67b61d0bdaed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:39.387891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aacaa-ad63-462b-92b0-9bcbbc887e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:39.388494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aacaa-ad63-462b-92b0-9bcbbc887e6f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:39.388774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aacaa-ad63-462b-92b0-9bcbbc887e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:39.389051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aacaa-ad63-462b-92b0-9bcbbc887e6f admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:39.389701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6aacaa-ad63-462b-92b0-9bcbbc887e6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:39.415163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6aacaa-ad63-462b-92b0-9bcbbc887e6f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:39.422584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 609/1218] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:36:39 2022] GET /identity/v3/services => generated 2430 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:36:41.428831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ea28-2328-4b75-a5ce-683c4185497a None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.429722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ea28-2328-4b75-a5ce-683c4185497a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.429722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ea28-2328-4b75-a5ce-683c4185497a None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.432508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 610/1219] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:36:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:36:41.438916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.440376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.440376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.469206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:36:41.470282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:36:41.477576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 610/1220] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:36:41 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:36:41.500884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ea28-2328-4b75-a5ce-683c4185497a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.521241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ea28-2328-4b75-a5ce-683c4185497a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.527351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.528066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.528345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.528617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.529243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:41.554468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.565399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING keystone.server.flask.application [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 18:36:41.566419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 611/1221] 10.222.0.18 () {56 vars in 1138 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 18:36:41.575949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.590345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd803259-5f49-4e65-a3c8-152b6b2a7683 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.597936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.598517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.598825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.599102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] PATH_INFO: `/v3/services` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.599772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:36:41.600137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:41.625079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548839-3124-4e5f-96b7-5c5e84cc5cf4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.630699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 611/1222] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Feb 28 18:36:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:36:41.636858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:36:41.653763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3c6e2-e543-4931-8b4d-1c211215c70f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:36:41.661233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447f26-6770-4759-8c7d-aa7a7d4e747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:36:41.661801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447f26-6770-4759-8c7d-aa7a7d4e747f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:36:41.662083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447f26-6770-4759-8c7d-aa7a7d4e747f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:36:41.662359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447f26-6770-4759-8c7d-aa7a7d4e747f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:36:41.663067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447f26-6770-4759-8c7d-aa7a7d4e747f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:36:41.687988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447f26-6770-4759-8c7d-aa7a7d4e747f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:36:41.720709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 612/1223] 10.222.0.18 () {60 vars in 1165 bytes} [Mon Feb 28 18:36:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:38:29.628433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315785-50a5-41ef-9103-74e3bce82c05 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:29.629383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315785-50a5-41ef-9103-74e3bce82c05 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:29.629839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315785-50a5-41ef-9103-74e3bce82c05 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:29.631738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 612/1224] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:29.637388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146332f-4165-4a6f-815e-6192487925f2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:29.637832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146332f-4165-4a6f-815e-6192487925f2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:29.638028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146332f-4165-4a6f-815e-6192487925f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:29.723943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c146332f-4165-4a6f-815e-6192487925f2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:29.725086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c146332f-4165-4a6f-815e-6192487925f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:29.833256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 613/1225] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:38:29.856086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76315785-50a5-41ef-9103-74e3bce82c05 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:29.857806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-76315785-50a5-41ef-9103-74e3bce82c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:30.012013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76315785-50a5-41ef-9103-74e3bce82c05 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:30.120922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fcc43-8c3e-41a1-8908-7122b93a3b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:30.121512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcc43-8c3e-41a1-8908-7122b93a3b09 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:30.121795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcc43-8c3e-41a1-8908-7122b93a3b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:30.122083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcc43-8c3e-41a1-8908-7122b93a3b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:30.122818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fcc43-8c3e-41a1-8908-7122b93a3b09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:30.148221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fcc43-8c3e-41a1-8908-7122b93a3b09 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:30.162829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 613/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:38:29 2022] GET /identity/v3/projects => generated 2553 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:38:32.167546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a35b7e-80cb-4564-9760-4ad5bafcb172 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.168297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a35b7e-80cb-4564-9760-4ad5bafcb172 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.168297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a35b7e-80cb-4564-9760-4ad5bafcb172 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.169777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 614/1227] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:38:32.176139 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735e03c-5a68-4afb-8ae3-f0f84514f9bf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.176859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735e03c-5a68-4afb-8ae3-f0f84514f9bf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.176859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735e03c-5a68-4afb-8ae3-f0f84514f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.267578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-2735e03c-5a68-4afb-8ae3-f0f84514f9bf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:32.268757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2735e03c-5a68-4afb-8ae3-f0f84514f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:32.376334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 614/1228] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:38:32.422350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b989-331c-4a33-a458-9148ab1ea1fe None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.422841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b989-331c-4a33-a458-9148ab1ea1fe None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.423150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b989-331c-4a33-a458-9148ab1ea1fe None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.424863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 615/1229] 10.222.0.18 () {54 vars in 963 bytes} [Mon Feb 28 18:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:32.430600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e79a-a27e-4213-a095-0121fba6f6f7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.430922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e79a-a27e-4213-a095-0121fba6f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.431210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177e79a-a27e-4213-a095-0121fba6f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.537061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8177e79a-a27e-4213-a095-0121fba6f6f7 None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:32.538202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8177e79a-a27e-4213-a095-0121fba6f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:32.637501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 615/1230] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Feb 28 18:38:32 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:32.651441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68b989-331c-4a33-a458-9148ab1ea1fe None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:32.652886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0f68b989-331c-4a33-a458-9148ab1ea1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:32.780867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68b989-331c-4a33-a458-9148ab1ea1fe None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:32.878711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:32.879310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:32.879591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:32.879865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:32.881392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:33.014848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:33.042157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd1e07-2f7d-4594-9a85-bc11ba3c97c0 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:33.076771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 616/1231] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:35.326408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837bd5-23b5-4fed-a26d-c3bc27ba6891 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.326997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837bd5-23b5-4fed-a26d-c3bc27ba6891 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.326997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e837bd5-23b5-4fed-a26d-c3bc27ba6891 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.329520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 616/1232] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:35.335060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7965-de65-4bf5-b010-7d9bb0a57477 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.335462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7965-de65-4bf5-b010-7d9bb0a57477 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.335632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7965-de65-4bf5-b010-7d9bb0a57477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.423572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9e6c7965-de65-4bf5-b010-7d9bb0a57477 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:35.424726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9e6c7965-de65-4bf5-b010-7d9bb0a57477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:35.532419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 617/1233] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:35.570289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837bd5-23b5-4fed-a26d-c3bc27ba6891 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:35.571430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1e837bd5-23b5-4fed-a26d-c3bc27ba6891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:35.694836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e837bd5-23b5-4fed-a26d-c3bc27ba6891 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:35.780783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:35.781360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:35.781643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:35.782026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:35.783662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:35.910451 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:35.935331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10012a-9f62-45b4-94fa-8856051f56fe service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:35.967736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 617/1234] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:38:38.220566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0328-c292-4294-b225-88747bbd20ab None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:38.221117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0328-c292-4294-b225-88747bbd20ab None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:38.221117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0328-c292-4294-b225-88747bbd20ab None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:38.223150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 618/1235] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:38.228504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e34d9b-0bc3-4017-b891-9dee49df4007 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:38.228917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e34d9b-0bc3-4017-b891-9dee49df4007 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:38.229026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e34d9b-0bc3-4017-b891-9dee49df4007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:38.329252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-90e34d9b-0bc3-4017-b891-9dee49df4007 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:38.330412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-90e34d9b-0bc3-4017-b891-9dee49df4007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:38.445053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 618/1236] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:38:38.478952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0328-c292-4294-b225-88747bbd20ab None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:38.480337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-220b0328-c292-4294-b225-88747bbd20ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:38.632499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0328-c292-4294-b225-88747bbd20ab None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:38.736950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de8e27-3d2e-46f5-869f-7b08a465af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:38.737669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de8e27-3d2e-46f5-869f-7b08a465af71 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:38.737952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de8e27-3d2e-46f5-869f-7b08a465af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:38.738228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de8e27-3d2e-46f5-869f-7b08a465af71 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:38.749036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de8e27-3d2e-46f5-869f-7b08a465af71 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:38.774591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de8e27-3d2e-46f5-869f-7b08a465af71 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:38.776165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 619/1237] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:38:38 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:38.813863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345349-7e76-4017-854d-9b4cf4396e9d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:38.814151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345349-7e76-4017-854d-9b4cf4396e9d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:38.814429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50345349-7e76-4017-854d-9b4cf4396e9d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:38.816159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 619/1238] 10.222.0.18 () {54 vars in 963 bytes} [Mon Feb 28 18:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:38.824479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a379-f8a8-4c67-bd5e-b61c00fb0df5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:38.824775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a379-f8a8-4c67-bd5e-b61c00fb0df5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:38.825056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a379-f8a8-4c67-bd5e-b61c00fb0df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:38.935607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3ee6a379-f8a8-4c67-bd5e-b61c00fb0df5 None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:38.936768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3ee6a379-f8a8-4c67-bd5e-b61c00fb0df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:39.026409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 620/1239] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Feb 28 18:38:38 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:39.035593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345349-7e76-4017-854d-9b4cf4396e9d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:39.037051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-50345349-7e76-4017-854d-9b4cf4396e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:39.162699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50345349-7e76-4017-854d-9b4cf4396e9d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:39.252056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:39.253031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:39.253418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:39.253884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:39.256488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:39.387337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:39.412671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e40663-7a79-43ab-9a33-f3537f88dd4d service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:39.435401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 620/1240] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:38:42.293545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808aa2-dcee-44c3-a1ee-20e3c576513c None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.294350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808aa2-dcee-44c3-a1ee-20e3c576513c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.294500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808aa2-dcee-44c3-a1ee-20e3c576513c None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.297228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 621/1241] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:42.303812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.304271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.304425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.399295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:42.400441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:42.506110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 621/1242] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:42.537878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53808aa2-dcee-44c3-a1ee-20e3c576513c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:42.539419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-53808aa2-dcee-44c3-a1ee-20e3c576513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:42.692104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53808aa2-dcee-44c3-a1ee-20e3c576513c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:42.794841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a82121-20b8-4f03-89c5-e9c7bb0dd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:42.795543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a82121-20b8-4f03-89c5-e9c7bb0dd480 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:42.795827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a82121-20b8-4f03-89c5-e9c7bb0dd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:42.796102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a82121-20b8-4f03-89c5-e9c7bb0dd480 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:42.807961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a82121-20b8-4f03-89c5-e9c7bb0dd480 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:42.833780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a82121-20b8-4f03-89c5-e9c7bb0dd480 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:42.835394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 622/1243] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:38:42 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:42.852523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:42.854325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:42.985272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20163bfd-d9fc-4539-93f1-c3cc52bac3f1 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:43.088539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:43.089164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:43.089536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:43.089913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:43.091734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:43.215452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:43.240435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a09eb0-522b-4f32-b5f6-b995c1f92664 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:43.263642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 622/1244] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:45.979643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369dc42-f040-4bea-b035-772f9ebccd6d None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:45.980173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369dc42-f040-4bea-b035-772f9ebccd6d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:45.980173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369dc42-f040-4bea-b035-772f9ebccd6d None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:45.981974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 623/1245] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:45.987337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3dbcf-c609-49d2-8b2f-024a13320058 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:45.987776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3dbcf-c609-49d2-8b2f-024a13320058 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:45.988021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3dbcf-c609-49d2-8b2f-024a13320058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:46.080247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f1b3dbcf-c609-49d2-8b2f-024a13320058 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:46.081515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f1b3dbcf-c609-49d2-8b2f-024a13320058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:46.199862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 623/1246] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:46.235545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369dc42-f040-4bea-b035-772f9ebccd6d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:46.237479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b369dc42-f040-4bea-b035-772f9ebccd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:46.361354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369dc42-f040-4bea-b035-772f9ebccd6d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:46.443320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:46.443900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:46.444177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:46.444452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:46.445963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:46.578624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:46.604169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1ec76-5f1f-4a6f-bf03-b90637aa27bc service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:46.624774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 624/1247] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:48.675859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2aed-a9ab-424d-9a3c-13cb64aa8875 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:48.676516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2aed-a9ab-424d-9a3c-13cb64aa8875 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:48.676516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2aed-a9ab-424d-9a3c-13cb64aa8875 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:48.678120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 624/1248] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:48.684061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3b33c-cf21-47d7-ac3a-12e03dbcdac2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:48.684558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3b33c-cf21-47d7-ac3a-12e03dbcdac2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:48.684652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3b33c-cf21-47d7-ac3a-12e03dbcdac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:48.776385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7db3b33c-cf21-47d7-ac3a-12e03dbcdac2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:48.777538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7db3b33c-cf21-47d7-ac3a-12e03dbcdac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:48.891572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 625/1249] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:48.926693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2aed-a9ab-424d-9a3c-13cb64aa8875 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:48.928156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2b2e2aed-a9ab-424d-9a3c-13cb64aa8875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:49.053888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e2aed-a9ab-424d-9a3c-13cb64aa8875 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:49.146609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:49.146609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:49.150583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:49.150583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:49.150583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:49.360433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:49.385406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aaeef-863b-4b67-aa4d-e83f802415f8 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:49.406663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 625/1250] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:38:51.468167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3b17-356c-41c3-8054-07a5d89ecd79 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:51.468748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3b17-356c-41c3-8054-07a5d89ecd79 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:51.468748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3b17-356c-41c3-8054-07a5d89ecd79 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:51.470455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 626/1251] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:51.477270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:51.477964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:51.478103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:51.576484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:51.577630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:51.685840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 626/1252] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:51.717651 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3b17-356c-41c3-8054-07a5d89ecd79 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:51.719149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-294b3b17-356c-41c3-8054-07a5d89ecd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:51.865581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3b17-356c-41c3-8054-07a5d89ecd79 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:51.975977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0fe20-b954-4889-9ac2-a9f6a986bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:51.976767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0fe20-b954-4889-9ac2-a9f6a986bdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:51.977046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0fe20-b954-4889-9ac2-a9f6a986bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:51.977328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0fe20-b954-4889-9ac2-a9f6a986bdf4 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:51.989160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0fe20-b954-4889-9ac2-a9f6a986bdf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:52.014547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0fe20-b954-4889-9ac2-a9f6a986bdf4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.016157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 627/1253] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:38:51 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:38:52.030084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:52.031807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:52.147238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab983ef3-f1d9-4a93-892a-b919d3e961ab None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:52.231262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:52.231848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:52.232129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:52.232403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:52.233914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:52.363477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:52.388604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17251f90-72a8-4343-a15e-5058d3197d57 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:52.409164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 627/1254] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:54.696633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f16a4-5c40-4ab3-8dcd-3b9e5e3f5baf None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:54.697192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f16a4-5c40-4ab3-8dcd-3b9e5e3f5baf None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:54.697192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f16a4-5c40-4ab3-8dcd-3b9e5e3f5baf None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:54.698866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 628/1255] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:54.705120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d07d-4058-4068-8b37-774c4f229f2b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:54.705537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d07d-4058-4068-8b37-774c4f229f2b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:54.705890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92d07d-4058-4068-8b37-774c4f229f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:54.808420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ef92d07d-4058-4068-8b37-774c4f229f2b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:54.809535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ef92d07d-4058-4068-8b37-774c4f229f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:54.925636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 628/1256] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:54.964659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f16a4-5c40-4ab3-8dcd-3b9e5e3f5baf None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:54.966963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-714f16a4-5c40-4ab3-8dcd-3b9e5e3f5baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:55.100524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f16a4-5c40-4ab3-8dcd-3b9e5e3f5baf None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:55.191727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:55.192318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:55.192603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:55.192873 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:55.194407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:55.321656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:55.347312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365316c7-57ca-4c66-8ebc-c8eb16a93313 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:55.369732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 629/1257] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:38:57.405697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc7474-d974-4a80-bcae-2547ce3c5e81 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:57.406527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc7474-d974-4a80-bcae-2547ce3c5e81 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:57.406690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc7474-d974-4a80-bcae-2547ce3c5e81 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:57.408972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 629/1258] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:38:57.414388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b8429-ff8c-49d3-8235-cff982a0f32f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:57.414840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b8429-ff8c-49d3-8235-cff982a0f32f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:57.414955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b8429-ff8c-49d3-8235-cff982a0f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:57.511219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c37b8429-ff8c-49d3-8235-cff982a0f32f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:38:57.512363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c37b8429-ff8c-49d3-8235-cff982a0f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:57.625519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 630/1259] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:38:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:38:57.679143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc7474-d974-4a80-bcae-2547ce3c5e81 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:38:57.680577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9efc7474-d974-4a80-bcae-2547ce3c5e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:57.826908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc7474-d974-4a80-bcae-2547ce3c5e81 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:38:57.917771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:38:57.918354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:38:57.918667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:38:57.918940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:38:57.920487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:38:58.046207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:38:58.071323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baa174-6fb9-496f-afae-f5dbe72adc91 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:38:58.094387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 630/1260] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:38:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:39:00.573656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8227-e96a-46d4-854d-c2d5b4b8ccc4 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.574688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8227-e96a-46d4-854d-c2d5b4b8ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.574688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8227-e96a-46d4-854d-c2d5b4b8ccc4 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.577286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 631/1261] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:00.585494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531eed0-639d-440b-b0a2-8f06764f5e46 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.586311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531eed0-639d-440b-b0a2-8f06764f5e46 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.586409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531eed0-639d-440b-b0a2-8f06764f5e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.682290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-4531eed0-639d-440b-b0a2-8f06764f5e46 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:00.683538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4531eed0-639d-440b-b0a2-8f06764f5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:00.807129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 631/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:00.851949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8227-e96a-46d4-854d-c2d5b4b8ccc4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:00.854327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-356f8227-e96a-46d4-854d-c2d5b4b8ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:00.975927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8227-e96a-46d4-854d-c2d5b4b8ccc4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:00.982238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c94e21-2396-400e-a2d6-b49a0149861c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:00.983082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c94e21-2396-400e-a2d6-b49a0149861c service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:00.983436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c94e21-2396-400e-a2d6-b49a0149861c service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:00.983812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c94e21-2396-400e-a2d6-b49a0149861c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:00.995343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c94e21-2396-400e-a2d6-b49a0149861c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:01.020772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c94e21-2396-400e-a2d6-b49a0149861c service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:01.030809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 632/1263] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:05.561688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd909-b501-43f5-b224-6ba489ad025f None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:05.562257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd909-b501-43f5-b224-6ba489ad025f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:05.562257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cd909-b501-43f5-b224-6ba489ad025f None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:05.563983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 632/1264] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:05.569975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e1e2-1479-4e9d-83d2-e192ff040c22 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:05.570529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e1e2-1479-4e9d-83d2-e192ff040c22 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:05.570529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316e1e2-1479-4e9d-83d2-e192ff040c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:05.594775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b316e1e2-1479-4e9d-83d2-e192ff040c22 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:05.596018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b316e1e2-1479-4e9d-83d2-e192ff040c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:05.603146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 633/1265] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:05.641430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd909-b501-43f5-b224-6ba489ad025f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:05.643463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8c1cd909-b501-43f5-b224-6ba489ad025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:05.657968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cd909-b501-43f5-b224-6ba489ad025f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:05.662081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905fe54-9faa-4632-a452-74ea953db2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:05.662674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fe54-9faa-4632-a452-74ea953db2fb service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:05.662957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fe54-9faa-4632-a452-74ea953db2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:05.663231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fe54-9faa-4632-a452-74ea953db2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:05.671971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905fe54-9faa-4632-a452-74ea953db2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:05.697118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905fe54-9faa-4632-a452-74ea953db2fb service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:05.706859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 633/1266] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:08.487417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889466-b193-405f-8317-821fd52d8130 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:08.488226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889466-b193-405f-8317-821fd52d8130 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:08.488226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889466-b193-405f-8317-821fd52d8130 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:08.491205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 634/1267] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:08.497580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6392-fb08-40e8-9435-4d721f06c400 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:08.498321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6392-fb08-40e8-9435-4d721f06c400 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:08.498630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6392-fb08-40e8-9435-4d721f06c400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:08.530593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5a6e6392-fb08-40e8-9435-4d721f06c400 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:08.531747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5a6e6392-fb08-40e8-9435-4d721f06c400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:08.540752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 634/1268] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:08.581115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41889466-b193-405f-8317-821fd52d8130 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:08.594222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41889466-b193-405f-8317-821fd52d8130 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:08.598149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecb357-3b8d-4c82-ba3f-1725174843ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:08.598790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb357-3b8d-4c82-ba3f-1725174843ce service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:08.599045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb357-3b8d-4c82-ba3f-1725174843ce service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:08.599455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecb357-3b8d-4c82-ba3f-1725174843ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:08.608201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecb357-3b8d-4c82-ba3f-1725174843ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:08.633574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecb357-3b8d-4c82-ba3f-1725174843ce service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:08.642813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 635/1269] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:13.190424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8811b-268f-414d-87e9-92409d8d9a82 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:13.190991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8811b-268f-414d-87e9-92409d8d9a82 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:13.190991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8811b-268f-414d-87e9-92409d8d9a82 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:13.192692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 635/1270] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:13.198172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c62a-bb44-4a0c-bf54-34595a7004e5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:13.198627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c62a-bb44-4a0c-bf54-34595a7004e5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:13.198760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c62a-bb44-4a0c-bf54-34595a7004e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:13.303189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3323c62a-bb44-4a0c-bf54-34595a7004e5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:13.304309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3323c62a-bb44-4a0c-bf54-34595a7004e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:13.311731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 636/1271] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:13.349229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8811b-268f-414d-87e9-92409d8d9a82 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:13.360158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8811b-268f-414d-87e9-92409d8d9a82 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:13.364213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58047-e5cb-4cea-8be0-f8f8b08f68f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:13.364779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58047-e5cb-4cea-8be0-f8f8b08f68f2 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:13.365092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58047-e5cb-4cea-8be0-f8f8b08f68f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:13.365365 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58047-e5cb-4cea-8be0-f8f8b08f68f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:13.379860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd58047-e5cb-4cea-8be0-f8f8b08f68f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:13.405919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd58047-e5cb-4cea-8be0-f8f8b08f68f2 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:13.416339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 636/1272] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:17.912169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ac03d-62a2-4253-ae9b-39b11c39d846 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:17.913333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ac03d-62a2-4253-ae9b-39b11c39d846 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:17.913857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ac03d-62a2-4253-ae9b-39b11c39d846 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:17.917409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 637/1273] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:39:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:17.922515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9680ec-af1b-4d05-839c-6c318bb3aaaf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:17.922938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9680ec-af1b-4d05-839c-6c318bb3aaaf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:17.923407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9680ec-af1b-4d05-839c-6c318bb3aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.030284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dd9680ec-af1b-4d05-839c-6c318bb3aaaf None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:18.031592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dd9680ec-af1b-4d05-839c-6c318bb3aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:18.133569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 637/1274] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:39:17 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:18.586828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f757e-fa13-4d30-8710-aa6b2eea62e6 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.588091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f757e-fa13-4d30-8710-aa6b2eea62e6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.588550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f757e-fa13-4d30-8710-aa6b2eea62e6 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.590898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 638/1275] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:18.597130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8340-4acc-47e4-8b76-dc789c37b57d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:18.597629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8340-4acc-47e4-8b76-dc789c37b57d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:18.598063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e8340-4acc-47e4-8b76-dc789c37b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:18.626442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-186e8340-4acc-47e4-8b76-dc789c37b57d None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:18.628369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-186e8340-4acc-47e4-8b76-dc789c37b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:18.656632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 638/1276] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:39:18 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:22.708254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d0f7-b269-466d-9fb7-53f989c57f1e None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:22.708795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d0f7-b269-466d-9fb7-53f989c57f1e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:22.709135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d0f7-b269-466d-9fb7-53f989c57f1e None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:22.711785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 639/1277] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:22.716803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb531e-6afc-4db3-8a33-18d1fef823fb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:22.717238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb531e-6afc-4db3-8a33-18d1fef823fb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:22.717377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb531e-6afc-4db3-8a33-18d1fef823fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:22.754769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-58fb531e-6afc-4db3-8a33-18d1fef823fb None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:22.756192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-58fb531e-6afc-4db3-8a33-18d1fef823fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:22.764943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 639/1278] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:39:22 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:24.083320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0aa8-95cb-443d-83d5-1dcd713773fa None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:24.083879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0aa8-95cb-443d-83d5-1dcd713773fa None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:24.083879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a0aa8-95cb-443d-83d5-1dcd713773fa None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:24.085822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 640/1279] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:24.090788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a595-619c-438b-a93e-1c8751a93eb9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:24.091217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a595-619c-438b-a93e-1c8751a93eb9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:24.091492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a595-619c-438b-a93e-1c8751a93eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:24.114675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-2574a595-619c-438b-a93e-1c8751a93eb9 None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:24.115820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2574a595-619c-438b-a93e-1c8751a93eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:24.123561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 640/1280] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:39:24 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:27.416569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16505-93d7-412f-bca9-138e42bdb421 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:27.417151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16505-93d7-412f-bca9-138e42bdb421 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:27.417151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16505-93d7-412f-bca9-138e42bdb421 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:27.419785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 641/1281] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:27.427979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e8bb-f83e-4175-bcb5-566d499cd9c0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:27.428420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e8bb-f83e-4175-bcb5-566d499cd9c0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:27.428529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e8bb-f83e-4175-bcb5-566d499cd9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:27.451215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8653e8bb-f83e-4175-bcb5-566d499cd9c0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:27.452320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8653e8bb-f83e-4175-bcb5-566d499cd9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:27.459816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 641/1282] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:27.554902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1badc6-b212-44e1-bb05-02a475312341 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:27.555331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1badc6-b212-44e1-bb05-02a475312341 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:27.555707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1badc6-b212-44e1-bb05-02a475312341 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:27.558408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 642/1283] 10.222.0.18 () {54 vars in 959 bytes} [Mon Feb 28 18:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:27.566073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52163c-1954-4d05-85cc-2f1f55f01c1c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:27.566360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52163c-1954-4d05-85cc-2f1f55f01c1c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:27.566675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52163c-1954-4d05-85cc-2f1f55f01c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:27.636543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-4e52163c-1954-4d05-85cc-2f1f55f01c1c None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:27.637688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4e52163c-1954-4d05-85cc-2f1f55f01c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:27.746093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 642/1284] 10.222.0.18 () {58 vars in 1056 bytes} [Mon Feb 28 18:39:27 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:27.754596 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1badc6-b212-44e1-bb05-02a475312341 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:27.770315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1badc6-b212-44e1-bb05-02a475312341 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:27.776554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68571def-c33b-4a9d-bb2c-94667dd6d68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:27.777128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68571def-c33b-4a9d-bb2c-94667dd6d68e service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:27.777412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68571def-c33b-4a9d-bb2c-94667dd6d68e service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:27.777698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68571def-c33b-4a9d-bb2c-94667dd6d68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:27.786678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68571def-c33b-4a9d-bb2c-94667dd6d68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:27.812117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68571def-c33b-4a9d-bb2c-94667dd6d68e service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:27.821490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 643/1285] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:29.977111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8429c-fa52-4cc7-95c1-c844c29a156d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:29.977981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8429c-fa52-4cc7-95c1-c844c29a156d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:29.977981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8429c-fa52-4cc7-95c1-c844c29a156d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:29.980638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 643/1286] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:29.986074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273319e4-8cd3-4109-85ef-f746e187e87d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:29.986589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273319e4-8cd3-4109-85ef-f746e187e87d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:29.986698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273319e4-8cd3-4109-85ef-f746e187e87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.009103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-273319e4-8cd3-4109-85ef-f746e187e87d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:30.010218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-273319e4-8cd3-4109-85ef-f746e187e87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:30.017627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 644/1287] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:30.121073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba534ca-7dd4-4035-a18b-d58faa202cbe None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.121324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba534ca-7dd4-4035-a18b-d58faa202cbe None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.121631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba534ca-7dd4-4035-a18b-d58faa202cbe None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.123343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 644/1288] 10.222.0.18 () {54 vars in 959 bytes} [Mon Feb 28 18:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:30.129795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff7ca-997a-4fb8-bb6c-2a97976b8125 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.130215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff7ca-997a-4fb8-bb6c-2a97976b8125 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.130644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceff7ca-997a-4fb8-bb6c-2a97976b8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.159615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-dceff7ca-997a-4fb8-bb6c-2a97976b8125 None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:30.160758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-dceff7ca-997a-4fb8-bb6c-2a97976b8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:30.171102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 645/1289] 10.222.0.18 () {58 vars in 1056 bytes} [Mon Feb 28 18:39:30 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:30.179211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba534ca-7dd4-4035-a18b-d58faa202cbe None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:30.192985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba534ca-7dd4-4035-a18b-d58faa202cbe None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:30.197941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe84b4-91e0-43d4-92ca-22ebad66be13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:30.198607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe84b4-91e0-43d4-92ca-22ebad66be13 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:30.198922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe84b4-91e0-43d4-92ca-22ebad66be13 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:30.199207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe84b4-91e0-43d4-92ca-22ebad66be13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:30.207279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe84b4-91e0-43d4-92ca-22ebad66be13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:30.232635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe84b4-91e0-43d4-92ca-22ebad66be13 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:30.243018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 645/1290] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:39:32.538723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9f745-e43f-48c6-b51e-1dadfa8a4cab None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:32.539304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9f745-e43f-48c6-b51e-1dadfa8a4cab None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:32.539304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9f745-e43f-48c6-b51e-1dadfa8a4cab None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:32.540978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 646/1291] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:32.547341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a412-420b-47ba-8975-e289354daff7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:32.548061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a412-420b-47ba-8975-e289354daff7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:32.548211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a412-420b-47ba-8975-e289354daff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:32.571719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8c45a412-420b-47ba-8975-e289354daff7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:32.572866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8c45a412-420b-47ba-8975-e289354daff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:32.580292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 646/1292] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:32.672004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9f745-e43f-48c6-b51e-1dadfa8a4cab None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:32.687568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9f745-e43f-48c6-b51e-1dadfa8a4cab None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:32.693337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad08d21-cc01-4e90-a010-2e221c29afa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:32.693888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08d21-cc01-4e90-a010-2e221c29afa7 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:32.694165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08d21-cc01-4e90-a010-2e221c29afa7 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:32.694443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad08d21-cc01-4e90-a010-2e221c29afa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:32.702670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad08d21-cc01-4e90-a010-2e221c29afa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:32.729165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad08d21-cc01-4e90-a010-2e221c29afa7 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:32.739045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 647/1293] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:35.017049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e3a6-1e29-4ff8-ab01-703efa0ae253 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.018122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e3a6-1e29-4ff8-ab01-703efa0ae253 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.018122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e3a6-1e29-4ff8-ab01-703efa0ae253 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.020134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 647/1294] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:35.028350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a04c8d-4744-448e-a4d7-bc18be526f54 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.028855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a04c8d-4744-448e-a4d7-bc18be526f54 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.028953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a04c8d-4744-448e-a4d7-bc18be526f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.054595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-17a04c8d-4744-448e-a4d7-bc18be526f54 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:35.055761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-17a04c8d-4744-448e-a4d7-bc18be526f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:35.068949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 648/1295] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:39:35.156602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6e3a6-1e29-4ff8-ab01-703efa0ae253 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:35.172233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6e3a6-1e29-4ff8-ab01-703efa0ae253 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:35.178593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a2806-6238-44bb-beed-608625e02baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:35.179196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2806-6238-44bb-beed-608625e02baa service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:35.179476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2806-6238-44bb-beed-608625e02baa service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:35.179772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2806-6238-44bb-beed-608625e02baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:35.188413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a2806-6238-44bb-beed-608625e02baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:35.214924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a2806-6238-44bb-beed-608625e02baa service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:35.224609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 648/1296] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:37.429020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3004d-a7a5-44b5-9839-b19b97daca53 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:37.429909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3004d-a7a5-44b5-9839-b19b97daca53 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:37.429909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3004d-a7a5-44b5-9839-b19b97daca53 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:37.432726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 649/1297] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:37.441833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff117b4-5985-4f4b-93c1-e3a4a6a4520d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:37.442641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff117b4-5985-4f4b-93c1-e3a4a6a4520d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:37.442789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff117b4-5985-4f4b-93c1-e3a4a6a4520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:37.471080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-2ff117b4-5985-4f4b-93c1-e3a4a6a4520d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:37.472217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2ff117b4-5985-4f4b-93c1-e3a4a6a4520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:37.480762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 649/1298] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:37.569325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3004d-a7a5-44b5-9839-b19b97daca53 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:37.584608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3004d-a7a5-44b5-9839-b19b97daca53 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:37.590785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcbcfe-7e99-4c34-8634-4e7b7f21155e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:37.591347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcbcfe-7e99-4c34-8634-4e7b7f21155e service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:37.591627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcbcfe-7e99-4c34-8634-4e7b7f21155e service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:37.591899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcbcfe-7e99-4c34-8634-4e7b7f21155e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:37.599915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcbcfe-7e99-4c34-8634-4e7b7f21155e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:37.625503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcbcfe-7e99-4c34-8634-4e7b7f21155e service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:37.634962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 650/1299] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:39.720460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb89b-6379-4ec1-900d-29725e4185b8 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:39.721171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb89b-6379-4ec1-900d-29725e4185b8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:39.721290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb89b-6379-4ec1-900d-29725e4185b8 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:39.723001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 650/1300] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:39:39.728401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b079f-5f7a-4ea1-bf69-cca053eb66a5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:39.728805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b079f-5f7a-4ea1-bf69-cca053eb66a5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:39.728957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b079f-5f7a-4ea1-bf69-cca053eb66a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:39.753398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-fb8b079f-5f7a-4ea1-bf69-cca053eb66a5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:39.754532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fb8b079f-5f7a-4ea1-bf69-cca053eb66a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:39.763429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 651/1301] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:39.851910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb89b-6379-4ec1-900d-29725e4185b8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:39.870889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb89b-6379-4ec1-900d-29725e4185b8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:39.876891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d24848-a4ab-4ee5-ab3c-992d7df7253c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:39.877466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d24848-a4ab-4ee5-ab3c-992d7df7253c service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:39.877752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d24848-a4ab-4ee5-ab3c-992d7df7253c service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:39.878027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d24848-a4ab-4ee5-ab3c-992d7df7253c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:39.885998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d24848-a4ab-4ee5-ab3c-992d7df7253c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:39.911674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d24848-a4ab-4ee5-ab3c-992d7df7253c service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:39.920507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 651/1302] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:42.009053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d535-1b3c-497b-b480-630b091e73d6 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.009650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d535-1b3c-497b-b480-630b091e73d6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.009650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d535-1b3c-497b-b480-630b091e73d6 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.011362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 652/1303] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:42.018085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a872e2-e96b-46f3-abba-09064778c40d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.018646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a872e2-e96b-46f3-abba-09064778c40d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.018755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a872e2-e96b-46f3-abba-09064778c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.042442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-82a872e2-e96b-46f3-abba-09064778c40d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:42.043619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-82a872e2-e96b-46f3-abba-09064778c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:42.051549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 652/1304] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:42.146816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d535-1b3c-497b-b480-630b091e73d6 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:42.164426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d535-1b3c-497b-b480-630b091e73d6 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:42.171136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8858d-3181-4697-bc49-138cd659cd71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:42.171733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8858d-3181-4697-bc49-138cd659cd71 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:42.172012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8858d-3181-4697-bc49-138cd659cd71 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:42.172422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8858d-3181-4697-bc49-138cd659cd71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:42.182091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8858d-3181-4697-bc49-138cd659cd71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:42.207154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8858d-3181-4697-bc49-138cd659cd71 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:42.217310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 653/1305] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:44.183942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d0341-7860-414e-beb6-899c394bfb20 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:44.184497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d0341-7860-414e-beb6-899c394bfb20 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:44.184497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d0341-7860-414e-beb6-899c394bfb20 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:44.186223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 653/1306] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:44.191701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb22d7-1ea5-44f5-87f6-8dc945c3c02e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:44.192152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb22d7-1ea5-44f5-87f6-8dc945c3c02e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:44.192248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb22d7-1ea5-44f5-87f6-8dc945c3c02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:44.215427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-92cb22d7-1ea5-44f5-87f6-8dc945c3c02e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:44.216562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-92cb22d7-1ea5-44f5-87f6-8dc945c3c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:44.224096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 654/1307] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:44.314212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d0341-7860-414e-beb6-899c394bfb20 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:44.335812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d0341-7860-414e-beb6-899c394bfb20 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:44.341399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767b235-942a-4430-95f3-e02ef3d61ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:44.341976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767b235-942a-4430-95f3-e02ef3d61ccb service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:44.342264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767b235-942a-4430-95f3-e02ef3d61ccb service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:44.342543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767b235-942a-4430-95f3-e02ef3d61ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:44.350969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767b235-942a-4430-95f3-e02ef3d61ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:44.375904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767b235-942a-4430-95f3-e02ef3d61ccb service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:44.384954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 654/1308] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:46.529053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e42ee6-65b3-441b-b0ac-6782f201d651 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:46.529603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e42ee6-65b3-441b-b0ac-6782f201d651 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:46.529603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e42ee6-65b3-441b-b0ac-6782f201d651 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:46.531317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 655/1309] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:46.537297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c182fd-6afb-4e14-9f20-f63f1d1d7296 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:46.537761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c182fd-6afb-4e14-9f20-f63f1d1d7296 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:46.537872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c182fd-6afb-4e14-9f20-f63f1d1d7296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:46.563426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c4c182fd-6afb-4e14-9f20-f63f1d1d7296 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:46.564697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c4c182fd-6afb-4e14-9f20-f63f1d1d7296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:46.573303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 655/1310] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:46.661662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e42ee6-65b3-441b-b0ac-6782f201d651 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:46.677575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e42ee6-65b3-441b-b0ac-6782f201d651 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:46.683547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2d4e5-0eeb-4155-9d0b-4a70333371d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:46.684110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d4e5-0eeb-4155-9d0b-4a70333371d4 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:46.684392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d4e5-0eeb-4155-9d0b-4a70333371d4 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:46.684660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d4e5-0eeb-4155-9d0b-4a70333371d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:46.694115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2d4e5-0eeb-4155-9d0b-4a70333371d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:46.719714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2d4e5-0eeb-4155-9d0b-4a70333371d4 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:46.729405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 656/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:48.831386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0418b94-e24e-4195-a19f-e917dfcc9f2d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:48.831947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0418b94-e24e-4195-a19f-e917dfcc9f2d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:48.831947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0418b94-e24e-4195-a19f-e917dfcc9f2d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:48.833642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 656/1312] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:48.840372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf57d9-06fe-47ca-8904-a421dae91a7f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:48.841130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf57d9-06fe-47ca-8904-a421dae91a7f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:48.841310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf57d9-06fe-47ca-8904-a421dae91a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:48.872771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-eddf57d9-06fe-47ca-8904-a421dae91a7f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:48.873897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-eddf57d9-06fe-47ca-8904-a421dae91a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:48.882200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 657/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:48.973560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0418b94-e24e-4195-a19f-e917dfcc9f2d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:48.989033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0418b94-e24e-4195-a19f-e917dfcc9f2d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:48.995090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163593d-be98-442f-b3b5-a4bad7127d8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:48.995652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163593d-be98-442f-b3b5-a4bad7127d8b service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:48.995938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163593d-be98-442f-b3b5-a4bad7127d8b service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:48.996219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163593d-be98-442f-b3b5-a4bad7127d8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:49.004423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163593d-be98-442f-b3b5-a4bad7127d8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:49.029582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163593d-be98-442f-b3b5-a4bad7127d8b service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:49.039665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 657/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:51.137500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afefe3-4b3c-45fb-9aba-3a611e5888a4 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:51.138062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afefe3-4b3c-45fb-9aba-3a611e5888a4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:51.138062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afefe3-4b3c-45fb-9aba-3a611e5888a4 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:51.139778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 658/1315] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:51.146317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7eaf5-f30b-462c-a7c7-9d19480efac4 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:51.147085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7eaf5-f30b-462c-a7c7-9d19480efac4 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:51.147363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7eaf5-f30b-462c-a7c7-9d19480efac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:51.180907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1ac7eaf5-f30b-462c-a7c7-9d19480efac4 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:51.182051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1ac7eaf5-f30b-462c-a7c7-9d19480efac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:51.189419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 658/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:51.277753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afefe3-4b3c-45fb-9aba-3a611e5888a4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:51.292828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afefe3-4b3c-45fb-9aba-3a611e5888a4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:51.298733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef092ab-d739-4299-b105-b0e7a0b64b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:51.299316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef092ab-d739-4299-b105-b0e7a0b64b83 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:51.299599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef092ab-d739-4299-b105-b0e7a0b64b83 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:51.299860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef092ab-d739-4299-b105-b0e7a0b64b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:51.307882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef092ab-d739-4299-b105-b0e7a0b64b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:51.333356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef092ab-d739-4299-b105-b0e7a0b64b83 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:51.342978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 659/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:39:53.458159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96145-176e-4a3f-b462-1267aebc02ec None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:53.459100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96145-176e-4a3f-b462-1267aebc02ec None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:53.459100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be96145-176e-4a3f-b462-1267aebc02ec None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:53.462253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 659/1318] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:39:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:39:53.471609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92231ebf-8c11-48ef-8a5a-b81836f89255 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:53.472079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92231ebf-8c11-48ef-8a5a-b81836f89255 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:53.472185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92231ebf-8c11-48ef-8a5a-b81836f89255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:53.496283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-92231ebf-8c11-48ef-8a5a-b81836f89255 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:39:53.497339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-92231ebf-8c11-48ef-8a5a-b81836f89255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:39:53.504863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 660/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:39:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:39:53.596590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96145-176e-4a3f-b462-1267aebc02ec None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:39:53.616841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be96145-176e-4a3f-b462-1267aebc02ec None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:39:53.623570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767140c1-7995-4686-b669-b97575786acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:39:53.624139 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767140c1-7995-4686-b669-b97575786acc service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:39:53.624422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767140c1-7995-4686-b669-b97575786acc service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:39:53.624695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767140c1-7995-4686-b669-b97575786acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:39:53.633269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767140c1-7995-4686-b669-b97575786acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:39:53.658595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767140c1-7995-4686-b669-b97575786acc service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:39:53.667725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 660/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:39:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:40:03.904810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888246-a157-45ed-a0fc-8f993bc93e2d None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:03.905442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888246-a157-45ed-a0fc-8f993bc93e2d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:03.905442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe888246-a157-45ed-a0fc-8f993bc93e2d None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:03.907127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 661/1321] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:03.912913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86525-1fc4-44f2-a67f-1d4e6b0098f3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:03.913373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86525-1fc4-44f2-a67f-1d4e6b0098f3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:03.913467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86525-1fc4-44f2-a67f-1d4e6b0098f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:03.936939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-3dd86525-1fc4-44f2-a67f-1d4e6b0098f3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:03.938048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-3dd86525-1fc4-44f2-a67f-1d4e6b0098f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:03.946596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 661/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:04.009086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fe639-1cba-4ebd-b3b4-5f1fcc859278 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.009378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fe639-1cba-4ebd-b3b4-5f1fcc859278 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.009665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fe639-1cba-4ebd-b3b4-5f1fcc859278 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.011381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 662/1323] 10.222.0.18 () {54 vars in 962 bytes} [Mon Feb 28 18:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:04.016960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05788-23b5-4f49-a967-5c9aeaae9c0d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.017427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05788-23b5-4f49-a967-5c9aeaae9c0d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.017772 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf05788-23b5-4f49-a967-5c9aeaae9c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.087804 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-adf05788-23b5-4f49-a967-5c9aeaae9c0d None None] MFA Rules not processed for user `d60d7d7120b047c5b45fb922c8063048`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:04.088950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-adf05788-23b5-4f49-a967-5c9aeaae9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:04.157137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 662/1324] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Feb 28 18:40:04 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:04.164939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fe639-1cba-4ebd-b3b4-5f1fcc859278 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:04.177186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fe639-1cba-4ebd-b3b4-5f1fcc859278 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:04.180755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5053cc8-8eb7-4f14-b92f-afe9fc2d561d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:04.181694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053cc8-8eb7-4f14-b92f-afe9fc2d561d service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:04.182234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053cc8-8eb7-4f14-b92f-afe9fc2d561d service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:04.182716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5053cc8-8eb7-4f14-b92f-afe9fc2d561d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:04.193159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5053cc8-8eb7-4f14-b92f-afe9fc2d561d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:04.220387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5053cc8-8eb7-4f14-b92f-afe9fc2d561d service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:04.231225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 663/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:40:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:17.601634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6eb16-882e-4378-a450-7895e996058e None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:17.602202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6eb16-882e-4378-a450-7895e996058e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:17.602202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6eb16-882e-4378-a450-7895e996058e None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:17.603966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 663/1326] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:17.610045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f172ea2-18fc-43a1-92a2-ac8951cee0b5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:17.610580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f172ea2-18fc-43a1-92a2-ac8951cee0b5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:17.610715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f172ea2-18fc-43a1-92a2-ac8951cee0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:17.640823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0f172ea2-18fc-43a1-92a2-ac8951cee0b5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:17.642191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0f172ea2-18fc-43a1-92a2-ac8951cee0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:17.650774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 664/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:17.720368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde8b3-4054-4225-ac03-1842e6d7c442 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:17.720759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde8b3-4054-4225-ac03-1842e6d7c442 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:17.721033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde8b3-4054-4225-ac03-1842e6d7c442 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:17.722734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 664/1328] 10.222.0.18 () {54 vars in 961 bytes} [Mon Feb 28 18:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:17.729323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5cdf-3a5a-46f4-acfd-2ae036c8fbcb None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:17.729784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5cdf-3a5a-46f4-acfd-2ae036c8fbcb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:17.730119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5cdf-3a5a-46f4-acfd-2ae036c8fbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:17.808222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-de1a5cdf-3a5a-46f4-acfd-2ae036c8fbcb None None] MFA Rules not processed for user `b3caf8a53d924849b5cb756249a1a96f`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:17.809371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-de1a5cdf-3a5a-46f4-acfd-2ae036c8fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:17.879862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 665/1329] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Feb 28 18:40:17 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:17.894314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde8b3-4054-4225-ac03-1842e6d7c442 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:17.907000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde8b3-4054-4225-ac03-1842e6d7c442 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:17.910550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68534196-0d54-40d7-b292-6d84c07cf196 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3caf8a53d924849b5cb756249a1a96f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:17.911144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534196-0d54-40d7-b292-6d84c07cf196 service glance] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:17.911429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534196-0d54-40d7-b292-6d84c07cf196 service glance] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:17.911700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68534196-0d54-40d7-b292-6d84c07cf196 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:17.920270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534196-0d54-40d7-b292-6d84c07cf196 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:17.945308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68534196-0d54-40d7-b292-6d84c07cf196 service glance] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:17.954473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 665/1330] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:40:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:40:18.360885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e4c7-e82f-4177-98b7-24b21d7b37e9 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.361321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e4c7-e82f-4177-98b7-24b21d7b37e9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.361675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357e4c7-e82f-4177-98b7-24b21d7b37e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.447311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c357e4c7-e82f-4177-98b7-24b21d7b37e9 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:18.448348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c357e4c7-e82f-4177-98b7-24b21d7b37e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:18.534052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 666/1331] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:40:18 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:18.580674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff336b-13c9-4fbe-a907-b694c61b30ac None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.580968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff336b-13c9-4fbe-a907-b694c61b30ac None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.581251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff336b-13c9-4fbe-a907-b694c61b30ac None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.582994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 666/1332] 10.222.0.18 () {54 vars in 942 bytes} [Mon Feb 28 18:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:18.589422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850d57-f489-4ff3-a426-e4e72be5e697 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.589700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850d57-f489-4ff3-a426-e4e72be5e697 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.590005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a850d57-f489-4ff3-a426-e4e72be5e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.659657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-6a850d57-f489-4ff3-a426-e4e72be5e697 None None] MFA Rules not processed for user `08b74d6c68e049ad8744b504680d1af0`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:18.660787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6a850d57-f489-4ff3-a426-e4e72be5e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:18.751927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 667/1333] 10.222.0.18 () {58 vars in 1039 bytes} [Mon Feb 28 18:40:18 2022] POST /identity/v3/auth/tokens => generated 3734 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:18.761040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff336b-13c9-4fbe-a907-b694c61b30ac None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:18.776500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff336b-13c9-4fbe-a907-b694c61b30ac None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:18.781235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e547-5588-4709-ba9d-3c11c1f77775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:18.781794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e547-5588-4709-ba9d-3c11c1f77775 service swift] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:18.782072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e547-5588-4709-ba9d-3c11c1f77775 service swift] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:18.782433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e547-5588-4709-ba9d-3c11c1f77775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:18.790225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e547-5588-4709-ba9d-3c11c1f77775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:18.815588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e547-5588-4709-ba9d-3c11c1f77775 service swift] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:18.823253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 667/1334] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:40:37.897080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d1073-209f-47fc-95d7-11d690b36f33 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:37.897727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d1073-209f-47fc-95d7-11d690b36f33 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:37.897727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d1073-209f-47fc-95d7-11d690b36f33 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:37.899302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 668/1335] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:37.904738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095694-b3f0-4835-a4dc-ad65602f977c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:37.905208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095694-b3f0-4835-a4dc-ad65602f977c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:37.905314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0095694-b3f0-4835-a4dc-ad65602f977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:37.941507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c0095694-b3f0-4835-a4dc-ad65602f977c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:37.942651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c0095694-b3f0-4835-a4dc-ad65602f977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:37.951317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 668/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:37.974344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d1073-209f-47fc-95d7-11d690b36f33 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:37.988259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d1073-209f-47fc-95d7-11d690b36f33 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:37.995085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc249dd-35dd-4a93-9d8a-37709752ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:37.995912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc249dd-35dd-4a93-9d8a-37709752ba67 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:37.996274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc249dd-35dd-4a93-9d8a-37709752ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:37.996610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc249dd-35dd-4a93-9d8a-37709752ba67 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:37.997608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc249dd-35dd-4a93-9d8a-37709752ba67 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:38.024212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc249dd-35dd-4a93-9d8a-37709752ba67 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:38.040579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 669/1337] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:40:37 2022] GET /identity/v3/projects => generated 2553 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:40:39.978549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a38db-5427-461a-99a8-f1e63a89a1b8 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:39.979097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a38db-5427-461a-99a8-f1e63a89a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:39.979097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a38db-5427-461a-99a8-f1e63a89a1b8 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:39.981720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 669/1338] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:39.988598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:39.989082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:39.989186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:40.011361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:40.012477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:40.020346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 670/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:40:40.042976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a38db-5427-461a-99a8-f1e63a89a1b8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:40.056121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a38db-5427-461a-99a8-f1e63a89a1b8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:40.060791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:40.061565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:40.061851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:40.062129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] PATH_INFO: `/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:40.075509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c3c0e728d554f76a7ce01429aa5c2d6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:40.101840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:40.103479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 670/1340] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:40 2022] GET /identity/v3/projects/0c3c0e728d554f76a7ce01429aa5c2d6 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:40.109546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:40.118340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce46fd-fe95-4a44-aded-b270b86318eb None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:40.122967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:40.123540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:40.123822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:40.124095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:40.124816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] RBAC: Adding query filter params (scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:40.125106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:40.150984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:40.157826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 671/1341] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:40 2022] GET /identity/v3/role_assignments?scope.project.id=0c3c0e728d554f76a7ce01429aa5c2d6 => generated 1934 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:40:40.163770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:40.173977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795ab65-cdd6-4c9c-8c60-f1961174cb67 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:40.179255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acc97d-fbad-4ac8-9237-31522162c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:40.180039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acc97d-fbad-4ac8-9237-31522162c96f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:40.180320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acc97d-fbad-4ac8-9237-31522162c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:40.180622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acc97d-fbad-4ac8-9237-31522162c96f admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:40.181801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acc97d-fbad-4ac8-9237-31522162c96f admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:40.207200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acc97d-fbad-4ac8-9237-31522162c96f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:40.208673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 671/1342] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:40 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:40.214844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:40.225124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dddfa-0adc-49f9-b7ac-bf44ac6fd5e5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:40.230646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7add61-944c-402a-9624-227ccb9c58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:40.231394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7add61-944c-402a-9624-227ccb9c58c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:40.231678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7add61-944c-402a-9624-227ccb9c58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:40.231959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7add61-944c-402a-9624-227ccb9c58c4 admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:40.252399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7add61-944c-402a-9624-227ccb9c58c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:40.278165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7add61-944c-402a-9624-227ccb9c58c4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:40.279733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 672/1343] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:40 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:42.323657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545212-3927-4abb-b07a-c06bc515ef56 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:42.324541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545212-3927-4abb-b07a-c06bc515ef56 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:42.324541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545212-3927-4abb-b07a-c06bc515ef56 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:42.327172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 672/1344] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:42.336237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:42.336691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:42.336795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:42.360312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:42.361616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:42.370187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 673/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:40:42.392549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545212-3927-4abb-b07a-c06bc515ef56 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:42.405454 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545212-3927-4abb-b07a-c06bc515ef56 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:42.410068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:42.410876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:42.411190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:42.411470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] PATH_INFO: `/v3/projects/135c7b26eb2e41df8d28464867dd66a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:42.424512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] RBAC: Authorizing `identity:get_project(project_id=135c7b26eb2e41df8d28464867dd66a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:42.450159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:42.451753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 673/1346] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:42 2022] GET /identity/v3/projects/135c7b26eb2e41df8d28464867dd66a8 => generated 302 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:42.458597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:42.471812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578348-9d48-4096-8738-b1bff27999ce None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:42.477973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:42.478576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:42.478875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:42.479160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:42.479882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] RBAC: Adding query filter params (scope.project.id=135c7b26eb2e41df8d28464867dd66a8) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:42.480181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:42.505681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:42.512513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 674/1347] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:42 2022] GET /identity/v3/role_assignments?scope.project.id=135c7b26eb2e41df8d28464867dd66a8 => generated 1934 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:40:42.518595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:42.528613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81f5e-7ba2-4fdc-9239-bcf174f3c09b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:42.534344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e97d-d8cb-4142-ae78-41b223ed49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:42.535168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e97d-d8cb-4142-ae78-41b223ed49e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:42.535450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e97d-d8cb-4142-ae78-41b223ed49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:42.535722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e97d-d8cb-4142-ae78-41b223ed49e5 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:42.536928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01e97d-d8cb-4142-ae78-41b223ed49e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:42.562331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01e97d-d8cb-4142-ae78-41b223ed49e5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:42.563864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 674/1348] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:42 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:42.569573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:42.580216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51d0da-d15a-47db-b179-18f21da90949 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:42.586601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd617-b086-4403-a4db-12a687d33f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:42.587412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd617-b086-4403-a4db-12a687d33f1f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:42.587695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd617-b086-4403-a4db-12a687d33f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:42.587971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd617-b086-4403-a4db-12a687d33f1f admin admin] PATH_INFO: `/v3/users/11cf6778ae894671b342e50ddfb59bb3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:42.608822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcd617-b086-4403-a4db-12a687d33f1f admin admin] RBAC: Authorizing `identity:get_user(user_id=11cf6778ae894671b342e50ddfb59bb3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:42.634766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcd617-b086-4403-a4db-12a687d33f1f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:42.636327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 675/1349] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:42 2022] GET /identity/v3/users/11cf6778ae894671b342e50ddfb59bb3 => generated 283 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:44.710406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af597b-b786-4ff0-92f5-5de629d2418b None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:44.711043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af597b-b786-4ff0-92f5-5de629d2418b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:44.711043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af597b-b786-4ff0-92f5-5de629d2418b None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:44.712719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 675/1350] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:44.718681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:44.719255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:44.719748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:44.742433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:44.743598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:44.751558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 676/1351] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:44.774317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af597b-b786-4ff0-92f5-5de629d2418b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:44.788485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af597b-b786-4ff0-92f5-5de629d2418b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:44.793120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:44.793902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:44.794191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:44.794469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] PATH_INFO: `/v3/projects/278f632221c040889e0fab7d5ad547b7` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:44.808900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=278f632221c040889e0fab7d5ad547b7)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:44.834535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:44.836196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 676/1352] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:44 2022] GET /identity/v3/projects/278f632221c040889e0fab7d5ad547b7 => generated 361 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:44.845659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:44.854590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51ff9-8e25-48c5-b49d-09d795bb3e73 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:44.860539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:44.861121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:44.861409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:44.861678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:44.862400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] RBAC: Adding query filter params (scope.project.id=278f632221c040889e0fab7d5ad547b7) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:44.862731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:44.888788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c321-4e6c-4381-b0c0-f1f2a55cfc70 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:44.895219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 677/1353] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:44 2022] GET /identity/v3/role_assignments?scope.project.id=278f632221c040889e0fab7d5ad547b7 => generated 526 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:44.900922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:44.911609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ffe0-1989-484d-aef1-43273d19d8f7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:44.916685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed4e28-b36f-4bd9-9844-95a1eeb54ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:44.917468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4e28-b36f-4bd9-9844-95a1eeb54ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:44.917748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4e28-b36f-4bd9-9844-95a1eeb54ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:44.918021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed4e28-b36f-4bd9-9844-95a1eeb54ad3 admin admin] PATH_INFO: `/v3/users/2d9eb26040994fbba8a672ae5615113d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:44.938237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed4e28-b36f-4bd9-9844-95a1eeb54ad3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2d9eb26040994fbba8a672ae5615113d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:44.965180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed4e28-b36f-4bd9-9844-95a1eeb54ad3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:44.966703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 677/1354] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:44 2022] GET /identity/v3/users/2d9eb26040994fbba8a672ae5615113d => generated 311 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:46.976011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237008-3c02-4da0-a0f2-483019670777 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:46.976898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237008-3c02-4da0-a0f2-483019670777 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:46.976898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237008-3c02-4da0-a0f2-483019670777 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:46.979701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 678/1355] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:46.988348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:46.989068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:46.989286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:47.019076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:47.020212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:47.027901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 678/1356] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:47.050957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237008-3c02-4da0-a0f2-483019670777 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:47.068325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237008-3c02-4da0-a0f2-483019670777 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:47.073336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:47.074149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:47.074431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:47.074746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] PATH_INFO: `/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:47.090025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d62f28d9f864b0ab7470e52d157f1c4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:47.117527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:47.119133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 679/1357] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:47 2022] GET /identity/v3/projects/3d62f28d9f864b0ab7470e52d157f1c4 => generated 311 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:47.128587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:47.142040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399e738-9c9a-4b94-9040-aea0e9a3c754 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:47.148846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:47.149433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:47.149715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:47.149996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:47.150765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] RBAC: Adding query filter params (scope.project.id=3d62f28d9f864b0ab7470e52d157f1c4) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:47.151062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:47.176322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57df765-9641-417d-a018-43323b09f27f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:47.182032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 679/1358] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:47 2022] GET /identity/v3/role_assignments?scope.project.id=3d62f28d9f864b0ab7470e52d157f1c4 => generated 526 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:47.187850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:47.197819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2becb1-970b-4930-97bc-842355f805a0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:47.203084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d849725-65a0-4c16-8ec3-0822b13c8bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:47.203963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849725-65a0-4c16-8ec3-0822b13c8bef admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:47.204408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849725-65a0-4c16-8ec3-0822b13c8bef admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:47.204810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849725-65a0-4c16-8ec3-0822b13c8bef admin admin] PATH_INFO: `/v3/users/ecd38da316b44c33a55e78e597a54e29` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:47.224742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d849725-65a0-4c16-8ec3-0822b13c8bef admin admin] RBAC: Authorizing `identity:get_user(user_id=ecd38da316b44c33a55e78e597a54e29)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:47.250625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d849725-65a0-4c16-8ec3-0822b13c8bef admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:47.252398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 680/1359] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:47 2022] GET /identity/v3/users/ecd38da316b44c33a55e78e597a54e29 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:49.289517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065739b-779f-4699-b0a3-90d174192f48 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:49.290404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065739b-779f-4699-b0a3-90d174192f48 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:49.290404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065739b-779f-4699-b0a3-90d174192f48 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:49.293169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 680/1360] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:49.301947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:49.302409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:49.302520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:49.325893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:49.327058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:49.335062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 681/1361] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:40:49.357537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065739b-779f-4699-b0a3-90d174192f48 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:49.371563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065739b-779f-4699-b0a3-90d174192f48 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:49.378507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:49.379697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:49.380095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:49.380443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] PATH_INFO: `/v3/projects/59acec3e713d40f0a23abdd9569d7387` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:49.382299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] RBAC: Authorizing `identity:get_project(project_id=59acec3e713d40f0a23abdd9569d7387)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:49.416149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:49.417709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 681/1362] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:49 2022] GET /identity/v3/projects/59acec3e713d40f0a23abdd9569d7387 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:49.425993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:49.439715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b7a9b-88a7-4e47-8e58-d9001a1b2461 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:49.447804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:49.448637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:49.449036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:49.449391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:49.450485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] RBAC: Adding query filter params (scope.project.id=59acec3e713d40f0a23abdd9569d7387) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:49.450958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:49.477383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a851f93-de1c-477c-9a6d-bbb78667885c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:49.483220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 682/1363] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:49 2022] GET /identity/v3/role_assignments?scope.project.id=59acec3e713d40f0a23abdd9569d7387 => generated 879 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:49.490022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:49.505521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee502-0115-4078-94f7-e5f583ec196e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:49.513328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ba9d-4ba1-44ad-878e-616f98b08be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:49.514477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ba9d-4ba1-44ad-878e-616f98b08be8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:49.514929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ba9d-4ba1-44ad-878e-616f98b08be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:49.515282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ba9d-4ba1-44ad-878e-616f98b08be8 admin admin] PATH_INFO: `/v3/users/3e8eb57551f64caeac7429bc645c3ee4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:49.516652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ba9d-4ba1-44ad-878e-616f98b08be8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e8eb57551f64caeac7429bc645c3ee4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:49.541912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ba9d-4ba1-44ad-878e-616f98b08be8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:49.543436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 682/1364] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:49 2022] GET /identity/v3/users/3e8eb57551f64caeac7429bc645c3ee4 => generated 247 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:51.540782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6b1f-0238-4528-9b51-46d45a589971 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:51.541629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6b1f-0238-4528-9b51-46d45a589971 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:51.541629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6b1f-0238-4528-9b51-46d45a589971 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:51.544385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 683/1365] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:51.549789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:51.550276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:51.550383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:51.574398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:51.575577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:51.587685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 683/1366] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:51.609880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d6b1f-0238-4528-9b51-46d45a589971 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:51.623116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d6b1f-0238-4528-9b51-46d45a589971 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:51.628165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:51.628939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:51.629224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:51.629499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] PATH_INFO: `/v3/projects/72086244e029413bbfd2949071c97092` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:51.644126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] RBAC: Authorizing `identity:get_project(project_id=72086244e029413bbfd2949071c97092)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:51.669628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:51.671226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 684/1367] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:51 2022] GET /identity/v3/projects/72086244e029413bbfd2949071c97092 => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:51.678646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:51.691103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a3f4-ab23-44cf-a3eb-938ae8f058a9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:51.699295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:51.700171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:51.700583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:51.700982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:51.702119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] RBAC: Adding query filter params (scope.project.id=72086244e029413bbfd2949071c97092) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:51.702570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:51.728354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:51.734491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 684/1368] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:51 2022] GET /identity/v3/role_assignments?scope.project.id=72086244e029413bbfd2949071c97092 => generated 877 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:51.742705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:51.752696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a3ce-abab-4b52-8bfc-2d3ca9d2fe86 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:51.758479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6152e-5647-4092-9fb4-095468472389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:51.759300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6152e-5647-4092-9fb4-095468472389 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:51.759609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6152e-5647-4092-9fb4-095468472389 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:51.759885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6152e-5647-4092-9fb4-095468472389 admin admin] PATH_INFO: `/v3/users/e84a0f95d1f748f7a278e5e0b6972d66` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:51.780799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6152e-5647-4092-9fb4-095468472389 admin admin] RBAC: Authorizing `identity:get_user(user_id=e84a0f95d1f748f7a278e5e0b6972d66)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:51.806652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6152e-5647-4092-9fb4-095468472389 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:51.808116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 685/1369] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:51 2022] GET /identity/v3/users/e84a0f95d1f748f7a278e5e0b6972d66 => generated 285 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:51.818704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:51.832517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb73db2-a081-4fc2-8404-d7ccff39488f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:51.838398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095af0a-4d4f-4cf9-84ba-70bc380d99ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:51.839222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095af0a-4d4f-4cf9-84ba-70bc380d99ac admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:51.839506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095af0a-4d4f-4cf9-84ba-70bc380d99ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:51.839790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095af0a-4d4f-4cf9-84ba-70bc380d99ac admin admin] PATH_INFO: `/v3/users/9c4361fa71764fce964d61cfcffcc354` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:51.860230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095af0a-4d4f-4cf9-84ba-70bc380d99ac admin admin] RBAC: Authorizing `identity:get_user(user_id=9c4361fa71764fce964d61cfcffcc354)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:51.887093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095af0a-4d4f-4cf9-84ba-70bc380d99ac admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:51.888681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 685/1370] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:51 2022] GET /identity/v3/users/9c4361fa71764fce964d61cfcffcc354 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:53.985876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320662e-993f-4cc8-81a9-beb3805ed4a4 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:53.986891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320662e-993f-4cc8-81a9-beb3805ed4a4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:53.986891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320662e-993f-4cc8-81a9-beb3805ed4a4 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:53.989381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 686/1371] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:53.995676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:53.996448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:53.996602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:54.027445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:54.028581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:54.036727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 686/1372] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:40:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:54.059805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320662e-993f-4cc8-81a9-beb3805ed4a4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:54.078981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320662e-993f-4cc8-81a9-beb3805ed4a4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:54.084607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:54.085496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:54.085783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:54.086063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] PATH_INFO: `/v3/projects/e626ecc8864844ba9d60eaae271adc1d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:54.100035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=e626ecc8864844ba9d60eaae271adc1d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:54.125437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:54.127119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 687/1373] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Feb 28 18:40:54 2022] GET /identity/v3/projects/e626ecc8864844ba9d60eaae271adc1d => generated 312 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:54.133394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:54.142445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255c3e-83bb-4884-a6da-e28615281530 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:54.148100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:54.148695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:54.148970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:54.149235 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:54.149974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] RBAC: Adding query filter params (scope.project.id=e626ecc8864844ba9d60eaae271adc1d) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:40:54.150268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:54.176245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6506ef-2fd6-4f4a-8eec-7db84179f551 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:54.182187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 687/1374] 10.222.0.18 () {56 vars in 1231 bytes} [Mon Feb 28 18:40:54 2022] GET /identity/v3/role_assignments?scope.project.id=e626ecc8864844ba9d60eaae271adc1d => generated 526 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:54.188372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:40:54.198541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88c60-2974-40d7-af86-2e75637ea4b6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:40:54.204230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674125b-97e0-438c-8707-2adf2c52061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:40:54.205020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674125b-97e0-438c-8707-2adf2c52061c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:54.205299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674125b-97e0-438c-8707-2adf2c52061c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:54.205574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674125b-97e0-438c-8707-2adf2c52061c admin admin] PATH_INFO: `/v3/users/66682466934f4f93b7c7be98ff60c7c0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:54.206803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674125b-97e0-438c-8707-2adf2c52061c admin admin] RBAC: Authorizing `identity:get_user(user_id=66682466934f4f93b7c7be98ff60c7c0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:40:54.232750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674125b-97e0-438c-8707-2adf2c52061c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:40:54.234233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 688/1375] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Feb 28 18:40:54 2022] GET /identity/v3/users/66682466934f4f93b7c7be98ff60c7c0 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:40:58.883932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d41f6-3de9-4f9f-b411-d91a4fe585fd None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:58.884500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d41f6-3de9-4f9f-b411-d91a4fe585fd None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:58.884500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d41f6-3de9-4f9f-b411-d91a4fe585fd None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:58.886156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 688/1376] 10.222.0.18 () {54 vars in 918 bytes} [Mon Feb 28 18:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:58.891579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec8bf-0737-44f9-9aa4-9e705090f930 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:58.891967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec8bf-0737-44f9-9aa4-9e705090f930 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:58.892145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec8bf-0737-44f9-9aa4-9e705090f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:58.916477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-199ec8bf-0737-44f9-9aa4-9e705090f930 None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:58.917613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-199ec8bf-0737-44f9-9aa4-9e705090f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:58.926897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 689/1377] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Feb 28 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:40:58.993300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878929c-e0eb-4c80-9bfc-8f12505c7b9a None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:58.993557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878929c-e0eb-4c80-9bfc-8f12505c7b9a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:58.993866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878929c-e0eb-4c80-9bfc-8f12505c7b9a None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:58.995602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 689/1378] 10.222.0.18 () {54 vars in 918 bytes} [Mon Feb 28 18:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:40:59.000963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925606a5-0d7f-4f25-82cc-4158abe4f51c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:40:59.001265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925606a5-0d7f-4f25-82cc-4158abe4f51c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:40:59.001568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925606a5-0d7f-4f25-82cc-4158abe4f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:40:59.025214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-925606a5-0d7f-4f25-82cc-4158abe4f51c None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:40:59.026357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-925606a5-0d7f-4f25-82cc-4158abe4f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:40:59.036578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 690/1379] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Feb 28 18:40:58 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:01.395105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984621cb-d6cb-4c89-87a9-e9f8e003e993 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:01.395659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984621cb-d6cb-4c89-87a9-e9f8e003e993 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:01.395659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984621cb-d6cb-4c89-87a9-e9f8e003e993 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:01.397320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:01.403622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb9b2-280c-4edb-8682-3833e1ad5625 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:01.404354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb9b2-280c-4edb-8682-3833e1ad5625 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:01.404518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb9b2-280c-4edb-8682-3833e1ad5625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:01.429491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c14cb9b2-280c-4edb-8682-3833e1ad5625 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:01.430665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c14cb9b2-280c-4edb-8682-3833e1ad5625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:01.440280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:01.529956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984621cb-d6cb-4c89-87a9-e9f8e003e993 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:01.551357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984621cb-d6cb-4c89-87a9-e9f8e003e993 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:01.557112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d55ea5-8335-4525-855c-c1aead89cc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:01.557681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55ea5-8335-4525-855c-c1aead89cc4a service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:01.557967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55ea5-8335-4525-855c-c1aead89cc4a service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:01.558246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55ea5-8335-4525-855c-c1aead89cc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:01.566820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d55ea5-8335-4525-855c-c1aead89cc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:01.592223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d55ea5-8335-4525-855c-c1aead89cc4a service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:01.601414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 691/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:02.993632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ae98-be9a-4e5f-920d-b4fc808816f9 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:02.994585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ae98-be9a-4e5f-920d-b4fc808816f9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:02.994585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ae98-be9a-4e5f-920d-b4fc808816f9 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:02.997223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:03.002233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1bcfe-2c76-464f-9a0a-6028f159dcd3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:03.002687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1bcfe-2c76-464f-9a0a-6028f159dcd3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:03.002777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1bcfe-2c76-464f-9a0a-6028f159dcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:03.027310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b6d1bcfe-2c76-464f-9a0a-6028f159dcd3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:03.028435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b6d1bcfe-2c76-464f-9a0a-6028f159dcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:03.036539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:03.186932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247ae98-be9a-4e5f-920d-b4fc808816f9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:03.207365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247ae98-be9a-4e5f-920d-b4fc808816f9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:03.213164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa094ed-0bff-4f8c-824c-913008372be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:03.213737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa094ed-0bff-4f8c-824c-913008372be6 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:03.214016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa094ed-0bff-4f8c-824c-913008372be6 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:03.214289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa094ed-0bff-4f8c-824c-913008372be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:03.223557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa094ed-0bff-4f8c-824c-913008372be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:03.249513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa094ed-0bff-4f8c-824c-913008372be6 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:03.259956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 693/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:04.713558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b82fa-80c7-4e7f-b287-34c14eacb38b None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:04.714442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b82fa-80c7-4e7f-b287-34c14eacb38b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:04.714442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b82fa-80c7-4e7f-b287-34c14eacb38b None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:04.717257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:04.723280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb4fc-69cf-46ad-90f5-507e9593860e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:04.723751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb4fc-69cf-46ad-90f5-507e9593860e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:04.723874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb4fc-69cf-46ad-90f5-507e9593860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:04.750954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f8cdb4fc-69cf-46ad-90f5-507e9593860e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:04.752102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f8cdb4fc-69cf-46ad-90f5-507e9593860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:04.760073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:04.924518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b82fa-80c7-4e7f-b287-34c14eacb38b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:04.944766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b82fa-80c7-4e7f-b287-34c14eacb38b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:04.950026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61233594-f214-4304-884d-ebf3650cd7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:04.950642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61233594-f214-4304-884d-ebf3650cd7de service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:04.950943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61233594-f214-4304-884d-ebf3650cd7de service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:04.951222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61233594-f214-4304-884d-ebf3650cd7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:04.959737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61233594-f214-4304-884d-ebf3650cd7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:04.985096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61233594-f214-4304-884d-ebf3650cd7de service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:04.994031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 694/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:06.450380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0d44-6d7c-481d-95be-da29c0ea1bcb None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:06.451035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0d44-6d7c-481d-95be-da29c0ea1bcb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:06.451035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b0d44-6d7c-481d-95be-da29c0ea1bcb None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:06.452656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:06.459550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef58666-b74d-470a-9503-9133b093d341 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:06.460300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef58666-b74d-470a-9503-9133b093d341 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:06.460480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef58666-b74d-470a-9503-9133b093d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:06.486963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cef58666-b74d-470a-9503-9133b093d341 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:06.488060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cef58666-b74d-470a-9503-9133b093d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:06.495824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:06.646393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b0d44-6d7c-481d-95be-da29c0ea1bcb None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:06.662476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b0d44-6d7c-481d-95be-da29c0ea1bcb None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:06.672255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c52a-b983-4da5-85ec-1ec51e3890ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:06.673031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c52a-b983-4da5-85ec-1ec51e3890ef service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:06.673335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c52a-b983-4da5-85ec-1ec51e3890ef service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:06.673598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c52a-b983-4da5-85ec-1ec51e3890ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:06.682230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c52a-b983-4da5-85ec-1ec51e3890ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:06.707666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c52a-b983-4da5-85ec-1ec51e3890ef service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:06.717045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 696/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:08.157667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc410492-25c5-4ad3-828a-689e0917bc8f None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:08.158275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc410492-25c5-4ad3-828a-689e0917bc8f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:08.158275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc410492-25c5-4ad3-828a-689e0917bc8f None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:08.159980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:08.166015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8980c3-336c-42c7-bbf3-bb20a6a7bdf6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:08.166464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8980c3-336c-42c7-bbf3-bb20a6a7bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:08.166670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8980c3-336c-42c7-bbf3-bb20a6a7bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:08.191128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8d8980c3-336c-42c7-bbf3-bb20a6a7bdf6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:08.192265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8d8980c3-336c-42c7-bbf3-bb20a6a7bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:08.201662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:08.352297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc410492-25c5-4ad3-828a-689e0917bc8f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:08.370340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc410492-25c5-4ad3-828a-689e0917bc8f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:08.376931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f24e0-d4bf-4d4a-a978-64e277dc9d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:08.377502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f24e0-d4bf-4d4a-a978-64e277dc9d26 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:08.377791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f24e0-d4bf-4d4a-a978-64e277dc9d26 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:08.378073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f24e0-d4bf-4d4a-a978-64e277dc9d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:08.385961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f24e0-d4bf-4d4a-a978-64e277dc9d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:08.411431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f24e0-d4bf-4d4a-a978-64e277dc9d26 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:08.420896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 697/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:09.805845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e3f73-0969-40cc-bd1d-013076119f2a None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:09.806755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e3f73-0969-40cc-bd1d-013076119f2a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:09.806889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e3f73-0969-40cc-bd1d-013076119f2a None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:09.809535 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:09.817519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8632-5561-4ec6-b3cd-2a90a7a2d2d1 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:09.817968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8632-5561-4ec6-b3cd-2a90a7a2d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:09.818119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8632-5561-4ec6-b3cd-2a90a7a2d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:09.845900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-80cb8632-5561-4ec6-b3cd-2a90a7a2d2d1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:09.847095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-80cb8632-5561-4ec6-b3cd-2a90a7a2d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:09.854629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:10.017284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e3f73-0969-40cc-bd1d-013076119f2a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:10.031748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e3f73-0969-40cc-bd1d-013076119f2a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:10.036502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92de78-1fe8-4fdd-ae4e-4caca304d4d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:10.037073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92de78-1fe8-4fdd-ae4e-4caca304d4d2 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:10.037357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92de78-1fe8-4fdd-ae4e-4caca304d4d2 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:10.037634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92de78-1fe8-4fdd-ae4e-4caca304d4d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:10.045397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92de78-1fe8-4fdd-ae4e-4caca304d4d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:10.071059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92de78-1fe8-4fdd-ae4e-4caca304d4d2 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:10.081070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 699/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:41:11.424396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe996015-4e8f-4e6b-94fb-1b32a9abb939 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:11.425246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe996015-4e8f-4e6b-94fb-1b32a9abb939 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:11.425246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe996015-4e8f-4e6b-94fb-1b32a9abb939 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:11.428010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:11.433908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca86659-bd78-4071-8f73-76b83cf14c85 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:11.434352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca86659-bd78-4071-8f73-76b83cf14c85 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:11.434478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca86659-bd78-4071-8f73-76b83cf14c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:11.464662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-aca86659-bd78-4071-8f73-76b83cf14c85 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:11.465842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-aca86659-bd78-4071-8f73-76b83cf14c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:11.473799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:11.627774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe996015-4e8f-4e6b-94fb-1b32a9abb939 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:11.650721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe996015-4e8f-4e6b-94fb-1b32a9abb939 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:11.659255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070263d-a868-4b08-9576-8709e38bac1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:11.659822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070263d-a868-4b08-9576-8709e38bac1e service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:11.660105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070263d-a868-4b08-9576-8709e38bac1e service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:11.660379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070263d-a868-4b08-9576-8709e38bac1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:11.668832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070263d-a868-4b08-9576-8709e38bac1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:11.694098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070263d-a868-4b08-9576-8709e38bac1e service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:11.703786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 700/1400] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:13.085118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62c9ad-468a-4bec-8582-52af855a48b1 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:13.085677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62c9ad-468a-4bec-8582-52af855a48b1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:13.085677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62c9ad-468a-4bec-8582-52af855a48b1 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:13.088327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:13.094066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af680c0-cfd9-4ab6-9d17-c8939872758d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:13.094539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af680c0-cfd9-4ab6-9d17-c8939872758d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:13.094672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af680c0-cfd9-4ab6-9d17-c8939872758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:13.118157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1af680c0-cfd9-4ab6-9d17-c8939872758d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:13.119332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1af680c0-cfd9-4ab6-9d17-c8939872758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:13.127532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:13.285408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62c9ad-468a-4bec-8582-52af855a48b1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:13.308039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62c9ad-468a-4bec-8582-52af855a48b1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:13.315344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc753de-dafe-4239-8d2b-c8d906fee5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:13.315911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc753de-dafe-4239-8d2b-c8d906fee5ea service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:13.316192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc753de-dafe-4239-8d2b-c8d906fee5ea service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:13.316465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc753de-dafe-4239-8d2b-c8d906fee5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:13.325519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc753de-dafe-4239-8d2b-c8d906fee5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:13.351397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc753de-dafe-4239-8d2b-c8d906fee5ea service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:13.361141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 702/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:14.741571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da893490-a944-46a7-b93f-db87f62ca22f None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:14.742448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da893490-a944-46a7-b93f-db87f62ca22f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:14.742448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da893490-a944-46a7-b93f-db87f62ca22f None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:14.745234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:41:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:14.752377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f083ba-d3fd-4e85-8317-5585df4251ea None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:14.752871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f083ba-d3fd-4e85-8317-5585df4251ea None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:14.752974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f083ba-d3fd-4e85-8317-5585df4251ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:14.776702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b2f083ba-d3fd-4e85-8317-5585df4251ea None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:14.777836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b2f083ba-d3fd-4e85-8317-5585df4251ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:14.791943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:41:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:14.944200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da893490-a944-46a7-b93f-db87f62ca22f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:14.962054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da893490-a944-46a7-b93f-db87f62ca22f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:14.967840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403628c-f7e1-42b4-a213-4c6362766c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:14.968480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403628c-f7e1-42b4-a213-4c6362766c57 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:14.968823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403628c-f7e1-42b4-a213-4c6362766c57 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:14.969108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403628c-f7e1-42b4-a213-4c6362766c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:14.977480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403628c-f7e1-42b4-a213-4c6362766c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:15.002669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403628c-f7e1-42b4-a213-4c6362766c57 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:15.011871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 703/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:41:16.947010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256ada-e331-4ea5-b6d0-eeea21c44738 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:16.947640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256ada-e331-4ea5-b6d0-eeea21c44738 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:16.947640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28256ada-e331-4ea5-b6d0-eeea21c44738 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:16.949245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:16.956239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051894d2-75ab-4e0b-af48-0c09e3ce830c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:16.957011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051894d2-75ab-4e0b-af48-0c09e3ce830c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:16.957154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051894d2-75ab-4e0b-af48-0c09e3ce830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:16.985991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-051894d2-75ab-4e0b-af48-0c09e3ce830c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:16.987186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-051894d2-75ab-4e0b-af48-0c09e3ce830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:16.997263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:17.037056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256ada-e331-4ea5-b6d0-eeea21c44738 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:17.055144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28256ada-e331-4ea5-b6d0-eeea21c44738 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:17.060847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2ed2-cffb-4509-ace8-ae0e6a60f79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:17.061661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2ed2-cffb-4509-ace8-ae0e6a60f79f service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:17.061997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2ed2-cffb-4509-ace8-ae0e6a60f79f service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:17.062578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2ed2-cffb-4509-ace8-ae0e6a60f79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:17.071664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d2ed2-cffb-4509-ace8-ae0e6a60f79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:17.097761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d2ed2-cffb-4509-ace8-ae0e6a60f79f service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:17.106876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 705/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:19.239691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca278-29ad-4197-8284-df0180c5b58c None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:19.240179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca278-29ad-4197-8284-df0180c5b58c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:19.240283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ca278-29ad-4197-8284-df0180c5b58c None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:19.242814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:19.250824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1fd1b-0fc5-45be-94a3-d028b2b13e43 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:19.251259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1fd1b-0fc5-45be-94a3-d028b2b13e43 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:19.251416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1fd1b-0fc5-45be-94a3-d028b2b13e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:19.277943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-bbf1fd1b-0fc5-45be-94a3-d028b2b13e43 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:19.279654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bbf1fd1b-0fc5-45be-94a3-d028b2b13e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:19.288785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:41:19.329534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca278-29ad-4197-8284-df0180c5b58c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:19.347075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ca278-29ad-4197-8284-df0180c5b58c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:19.351475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498897c-98e4-4f17-9d24-f5681f816636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:19.352054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498897c-98e4-4f17-9d24-f5681f816636 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:19.352458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498897c-98e4-4f17-9d24-f5681f816636 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:19.352743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498897c-98e4-4f17-9d24-f5681f816636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:19.362261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498897c-98e4-4f17-9d24-f5681f816636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:19.387310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498897c-98e4-4f17-9d24-f5681f816636 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:19.399940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 706/1412] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:21.831157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8f07-64b5-47d9-9ce2-67e887e839c9 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:21.831985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8f07-64b5-47d9-9ce2-67e887e839c9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:21.831985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f8f07-64b5-47d9-9ce2-67e887e839c9 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:21.835159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:21.841490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8e3f-971f-4db3-9dae-7c24f679702f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:21.842184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8e3f-971f-4db3-9dae-7c24f679702f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:21.842362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8e3f-971f-4db3-9dae-7c24f679702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:21.872724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-769a8e3f-971f-4db3-9dae-7c24f679702f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:21.873849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-769a8e3f-971f-4db3-9dae-7c24f679702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:21.881551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:21.920431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8f07-64b5-47d9-9ce2-67e887e839c9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:21.932480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f8f07-64b5-47d9-9ce2-67e887e839c9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:21.936551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b55faf-82e1-4f37-8ba6-8d27483a0295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:21.937585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b55faf-82e1-4f37-8ba6-8d27483a0295 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:21.937884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b55faf-82e1-4f37-8ba6-8d27483a0295 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:21.938158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b55faf-82e1-4f37-8ba6-8d27483a0295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:21.947410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b55faf-82e1-4f37-8ba6-8d27483a0295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:21.973445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b55faf-82e1-4f37-8ba6-8d27483a0295 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:21.982707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 708/1415] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:24.270279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccb21-b677-4902-855d-5bf24223e8ab None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:24.271122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccb21-b677-4902-855d-5bf24223e8ab None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:24.271264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccb21-b677-4902-855d-5bf24223e8ab None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:24.274006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:24.280353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447b6e-7659-4222-af73-f9ab58b0f36a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:24.281053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447b6e-7659-4222-af73-f9ab58b0f36a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:24.281250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61447b6e-7659-4222-af73-f9ab58b0f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:24.310050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-61447b6e-7659-4222-af73-f9ab58b0f36a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:24.311236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-61447b6e-7659-4222-af73-f9ab58b0f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:24.320561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:41:24.359720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccb21-b677-4902-855d-5bf24223e8ab None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:24.373258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccb21-b677-4902-855d-5bf24223e8ab None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:24.377997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6953-eab0-4040-808a-2bfb624eee9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:24.378543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6953-eab0-4040-808a-2bfb624eee9c service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:24.378853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6953-eab0-4040-808a-2bfb624eee9c service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:24.379127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6953-eab0-4040-808a-2bfb624eee9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:24.388124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6953-eab0-4040-808a-2bfb624eee9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:24.414175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6953-eab0-4040-808a-2bfb624eee9c service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:24.424210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 709/1418] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:26.531636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3b5f6-861a-49ca-8560-7163e0c4227b None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:26.532287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3b5f6-861a-49ca-8560-7163e0c4227b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:26.532559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3b5f6-861a-49ca-8560-7163e0c4227b None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:26.534241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:26.539813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1602ff-5c06-46b1-8832-2bd46a248af3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:26.540252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1602ff-5c06-46b1-8832-2bd46a248af3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:26.540411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1602ff-5c06-46b1-8832-2bd46a248af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:26.565495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6a1602ff-5c06-46b1-8832-2bd46a248af3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:26.566640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6a1602ff-5c06-46b1-8832-2bd46a248af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:26.575334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:26.617122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3b5f6-861a-49ca-8560-7163e0c4227b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:26.632481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3b5f6-861a-49ca-8560-7163e0c4227b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:26.636787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e01d43-ffc7-4d9d-bf24-6587e3163db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:26.637357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e01d43-ffc7-4d9d-bf24-6587e3163db4 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:26.637639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e01d43-ffc7-4d9d-bf24-6587e3163db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:26.637914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e01d43-ffc7-4d9d-bf24-6587e3163db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:26.647513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e01d43-ffc7-4d9d-bf24-6587e3163db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:26.673699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e01d43-ffc7-4d9d-bf24-6587e3163db4 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:26.682827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 711/1421] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:28.791453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b34ed-1eb6-4ab5-8d65-eb92ec4aac19 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:28.792362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b34ed-1eb6-4ab5-8d65-eb92ec4aac19 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:28.792362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b34ed-1eb6-4ab5-8d65-eb92ec4aac19 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:28.795049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:28.801550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814a8b-b26f-4b1c-9bc1-e56253bbf0dc None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:28.802339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814a8b-b26f-4b1c-9bc1-e56253bbf0dc None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:28.802484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1814a8b-b26f-4b1c-9bc1-e56253bbf0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:28.830766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c1814a8b-b26f-4b1c-9bc1-e56253bbf0dc None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:28.831921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c1814a8b-b26f-4b1c-9bc1-e56253bbf0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:28.839538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:28.879399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b34ed-1eb6-4ab5-8d65-eb92ec4aac19 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:28.898917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b34ed-1eb6-4ab5-8d65-eb92ec4aac19 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:28.904929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab31c9-a120-4380-9854-85dff094a516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:28.905756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab31c9-a120-4380-9854-85dff094a516 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:28.906134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab31c9-a120-4380-9854-85dff094a516 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:28.906437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab31c9-a120-4380-9854-85dff094a516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:28.916232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab31c9-a120-4380-9854-85dff094a516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:28.941395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab31c9-a120-4380-9854-85dff094a516 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:28.951445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 712/1424] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:31.059817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7d7c-2315-4176-95e4-d76811abf6dd None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:31.060642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7d7c-2315-4176-95e4-d76811abf6dd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:31.060808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d7d7c-2315-4176-95e4-d76811abf6dd None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:31.063271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:31.069938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314d9d-7da9-49de-a931-15922587c59e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:31.070727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314d9d-7da9-49de-a931-15922587c59e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:31.070847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc314d9d-7da9-49de-a931-15922587c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:31.109853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cc314d9d-7da9-49de-a931-15922587c59e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:31.111984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cc314d9d-7da9-49de-a931-15922587c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:31.125638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:31.175312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d7d7c-2315-4176-95e4-d76811abf6dd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:31.186026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d7d7c-2315-4176-95e4-d76811abf6dd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:31.189828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314043ce-955c-44f4-b99c-d0347e7e42a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:31.190384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314043ce-955c-44f4-b99c-d0347e7e42a2 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:31.190702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314043ce-955c-44f4-b99c-d0347e7e42a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:31.190978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314043ce-955c-44f4-b99c-d0347e7e42a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:31.200483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314043ce-955c-44f4-b99c-d0347e7e42a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:31.225826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314043ce-955c-44f4-b99c-d0347e7e42a2 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:31.235250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 714/1427] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:41:33.314365 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95a00-ec09-41c0-84c3-917c37518851 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:33.314987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95a00-ec09-41c0-84c3-917c37518851 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:33.314987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95a00-ec09-41c0-84c3-917c37518851 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:33.316655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:33.323043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dba27-0b75-4138-b553-3bbe587a6351 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:33.323787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dba27-0b75-4138-b553-3bbe587a6351 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:33.323971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0dba27-0b75-4138-b553-3bbe587a6351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:33.356109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0e0dba27-0b75-4138-b553-3bbe587a6351 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:33.357253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0e0dba27-0b75-4138-b553-3bbe587a6351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:33.365512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:33.405841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95a00-ec09-41c0-84c3-917c37518851 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:33.417708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95a00-ec09-41c0-84c3-917c37518851 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:33.422082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c1ceb-e80d-4426-93bc-b2608a86d414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:33.422710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c1ceb-e80d-4426-93bc-b2608a86d414 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:33.422992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c1ceb-e80d-4426-93bc-b2608a86d414 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:33.423266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c1ceb-e80d-4426-93bc-b2608a86d414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:33.433907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c1ceb-e80d-4426-93bc-b2608a86d414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:33.459045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c1ceb-e80d-4426-93bc-b2608a86d414 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:33.468821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 715/1430] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:41:35.508053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a593-d76b-40b5-94e5-6be8d98f3331 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:35.508595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a593-d76b-40b5-94e5-6be8d98f3331 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:35.508595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34a593-d76b-40b5-94e5-6be8d98f3331 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:35.510384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:35.516093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231d35-4dde-4b80-ade2-396fb1f43414 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:35.516489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231d35-4dde-4b80-ade2-396fb1f43414 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:35.516657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231d35-4dde-4b80-ade2-396fb1f43414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:35.543353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c6231d35-4dde-4b80-ade2-396fb1f43414 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:35.544514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c6231d35-4dde-4b80-ade2-396fb1f43414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:35.552164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:35.595122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34a593-d76b-40b5-94e5-6be8d98f3331 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:35.607629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34a593-d76b-40b5-94e5-6be8d98f3331 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:35.612237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ccf72-cd9a-4523-9aee-06c006b6f715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:35.612834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ccf72-cd9a-4523-9aee-06c006b6f715 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:35.613103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ccf72-cd9a-4523-9aee-06c006b6f715 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:35.613382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ccf72-cd9a-4523-9aee-06c006b6f715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:35.622360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ccf72-cd9a-4523-9aee-06c006b6f715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:35.647584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ccf72-cd9a-4523-9aee-06c006b6f715 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:35.656806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 717/1433] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:37.686876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8c09-ef65-4efa-a5cf-1ccf12490e85 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:37.687487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8c09-ef65-4efa-a5cf-1ccf12490e85 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:37.687854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe8c09-ef65-4efa-a5cf-1ccf12490e85 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:37.690643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:41:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:37.699645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f735-b0a5-4909-a850-f696543b9488 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:37.700074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f735-b0a5-4909-a850-f696543b9488 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:37.700253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f735-b0a5-4909-a850-f696543b9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:37.724791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e8c9f735-b0a5-4909-a850-f696543b9488 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:37.725931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e8c9f735-b0a5-4909-a850-f696543b9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:37.734697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:41:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:37.770995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe8c09-ef65-4efa-a5cf-1ccf12490e85 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:37.782732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe8c09-ef65-4efa-a5cf-1ccf12490e85 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:37.789358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371e11f-bfee-4c55-887b-f21e9f0b66f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:37.792739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e11f-bfee-4c55-887b-f21e9f0b66f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:37.792739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e11f-bfee-4c55-887b-f21e9f0b66f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:37.792739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e11f-bfee-4c55-887b-f21e9f0b66f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:37.799512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e11f-bfee-4c55-887b-f21e9f0b66f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:37.824309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e11f-bfee-4c55-887b-f21e9f0b66f8 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:37.833644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 718/1436] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:49.571756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14a30b-a520-4714-8be3-2515f0905005 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:49.572626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14a30b-a520-4714-8be3-2515f0905005 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:49.572626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14a30b-a520-4714-8be3-2515f0905005 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:49.575423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 719/1437] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:41:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:49.581763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c7a2-fbef-4aa5-a727-44a3f97cab5b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:49.582179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c7a2-fbef-4aa5-a727-44a3f97cab5b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:49.582331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c7a2-fbef-4aa5-a727-44a3f97cab5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:49.605793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-67c2c7a2-fbef-4aa5-a727-44a3f97cab5b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:49.606995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-67c2c7a2-fbef-4aa5-a727-44a3f97cab5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:49.615497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 719/1438] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:41:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:49.662210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14a30b-a520-4714-8be3-2515f0905005 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:49.674762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14a30b-a520-4714-8be3-2515f0905005 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:49.680622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab115ba-02d8-4120-8579-733ea9505bc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3caf8a53d924849b5cb756249a1a96f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:49.681429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab115ba-02d8-4120-8579-733ea9505bc4 service glance] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:49.681731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab115ba-02d8-4120-8579-733ea9505bc4 service glance] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:49.682008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab115ba-02d8-4120-8579-733ea9505bc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:49.695895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab115ba-02d8-4120-8579-733ea9505bc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:49.723573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab115ba-02d8-4120-8579-733ea9505bc4 service glance] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:49.733379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 720/1439] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:51.825836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930794-e03a-42ed-84e8-a4299e240cb0 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:51.826424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930794-e03a-42ed-84e8-a4299e240cb0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:51.826424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930794-e03a-42ed-84e8-a4299e240cb0 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:51.828246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 720/1440] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:51.834195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715512-f481-430f-ad31-97547c34bb0a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:51.834753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715512-f481-430f-ad31-97547c34bb0a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:51.834753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715512-f481-430f-ad31-97547c34bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:51.858368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cf715512-f481-430f-ad31-97547c34bb0a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:51.859636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cf715512-f481-430f-ad31-97547c34bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:51.867206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 721/1441] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:41:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:51.889145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930794-e03a-42ed-84e8-a4299e240cb0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:51.900869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930794-e03a-42ed-84e8-a4299e240cb0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:51.904797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee92e0-971d-4f3c-a15d-39935ed0a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:51.905427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee92e0-971d-4f3c-a15d-39935ed0a533 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:51.906076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee92e0-971d-4f3c-a15d-39935ed0a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:51.906076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee92e0-971d-4f3c-a15d-39935ed0a533 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:51.906707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee92e0-971d-4f3c-a15d-39935ed0a533 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:51.931840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee92e0-971d-4f3c-a15d-39935ed0a533 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:51.947922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 721/1442] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Feb 28 18:41:51 2022] GET /identity/v3/projects => generated 2553 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:41:53.488693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d48d-abe2-4480-8a99-e19971901394 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:53.489541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d48d-abe2-4480-8a99-e19971901394 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:53.489541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d48d-abe2-4480-8a99-e19971901394 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:53.492251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 722/1443] 10.222.0.18 () {54 vars in 911 bytes} [Mon Feb 28 18:41:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:53.500269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8073c-d689-4882-b9b9-38bd0bb8cc2d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:53.500718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8073c-d689-4882-b9b9-38bd0bb8cc2d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:53.500923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8073c-d689-4882-b9b9-38bd0bb8cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:53.529144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-46b8073c-d689-4882-b9b9-38bd0bb8cc2d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:53.530520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-46b8073c-d689-4882-b9b9-38bd0bb8cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:53.539606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 722/1444] 10.222.0.18 () {58 vars in 1008 bytes} [Mon Feb 28 18:41:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:53.690018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d48d-abe2-4480-8a99-e19971901394 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:53.706275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d48d-abe2-4480-8a99-e19971901394 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:53.712547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e98e9-e95e-4823-a592-0a8780116f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:53.713110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e98e9-e95e-4823-a592-0a8780116f55 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:53.713398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e98e9-e95e-4823-a592-0a8780116f55 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:53.713673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e98e9-e95e-4823-a592-0a8780116f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:53.727151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e98e9-e95e-4823-a592-0a8780116f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:53.756722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e98e9-e95e-4823-a592-0a8780116f55 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:53.766878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 723/1445] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:55.825755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daf88e-6c15-4aae-a651-2ed20c25a3a7 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:55.826456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daf88e-6c15-4aae-a651-2ed20c25a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:55.826456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daf88e-6c15-4aae-a651-2ed20c25a3a7 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:55.828824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 723/1446] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:41:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:55.835448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e464c-cef8-4d16-89fc-0667f086c5b6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:55.835922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e464c-cef8-4d16-89fc-0667f086c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:55.836028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e464c-cef8-4d16-89fc-0667f086c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:55.861670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-405e464c-cef8-4d16-89fc-0667f086c5b6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:55.862881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-405e464c-cef8-4d16-89fc-0667f086c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:55.870263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 724/1447] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:41:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:55.907347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daf88e-6c15-4aae-a651-2ed20c25a3a7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:55.925605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daf88e-6c15-4aae-a651-2ed20c25a3a7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:55.930234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92085ad-078b-47cc-8901-1599936b4367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:55.930852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92085ad-078b-47cc-8901-1599936b4367 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:55.931163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92085ad-078b-47cc-8901-1599936b4367 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:55.931440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92085ad-078b-47cc-8901-1599936b4367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:55.941321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92085ad-078b-47cc-8901-1599936b4367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:55.966485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92085ad-078b-47cc-8901-1599936b4367 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:55.976649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 724/1448] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:41:58.004826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c4b6-232d-43f9-82e6-86b607a3ce21 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:58.005674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c4b6-232d-43f9-82e6-86b607a3ce21 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:58.005789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c4b6-232d-43f9-82e6-86b607a3ce21 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:58.008455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 725/1449] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:41:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:41:58.014966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cc5e-c3b1-4678-a273-b0edab78123f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:58.015492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cc5e-c3b1-4678-a273-b0edab78123f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:58.015603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cc5e-c3b1-4678-a273-b0edab78123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:58.039966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cf55cc5e-c3b1-4678-a273-b0edab78123f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:41:58.041115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cf55cc5e-c3b1-4678-a273-b0edab78123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:41:58.050052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 725/1450] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:41:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:41:58.092002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c4b6-232d-43f9-82e6-86b607a3ce21 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:41:58.102724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c4b6-232d-43f9-82e6-86b607a3ce21 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:41:58.106013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd151b-0c25-4be6-a556-e40bc8805d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:41:58.106645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd151b-0c25-4be6-a556-e40bc8805d10 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:41:58.106931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd151b-0c25-4be6-a556-e40bc8805d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:41:58.107206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd151b-0c25-4be6-a556-e40bc8805d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:41:58.115989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd151b-0c25-4be6-a556-e40bc8805d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:41:58.140990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd151b-0c25-4be6-a556-e40bc8805d10 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:41:58.149980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 726/1451] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:41:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:42:00.305092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9b05d-8979-48eb-846d-4a148b6f531d None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:42:00.305654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9b05d-8979-48eb-846d-4a148b6f531d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:42:00.305654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9b05d-8979-48eb-846d-4a148b6f531d None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:42:00.307373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 726/1452] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:42:00.313200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ef8a-f6c9-4dca-b95c-8710498963cc None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:42:00.313700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ef8a-f6c9-4dca-b95c-8710498963cc None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:42:00.313700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ef8a-f6c9-4dca-b95c-8710498963cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:42:00.343302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c6e2ef8a-f6c9-4dca-b95c-8710498963cc None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:42:00.344449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c6e2ef8a-f6c9-4dca-b95c-8710498963cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:42:00.354146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 727/1453] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:42:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:42:00.400532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9b05d-8979-48eb-846d-4a148b6f531d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:42:00.413646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9b05d-8979-48eb-846d-4a148b6f531d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:42:00.417833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4c11d-00b3-42f6-8c59-b85a28c1bee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:42:00.418396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4c11d-00b3-42f6-8c59-b85a28c1bee4 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:42:00.418703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4c11d-00b3-42f6-8c59-b85a28c1bee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:42:00.418976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4c11d-00b3-42f6-8c59-b85a28c1bee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:42:00.431941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4c11d-00b3-42f6-8c59-b85a28c1bee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:42:00.458947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4c11d-00b3-42f6-8c59-b85a28c1bee4 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:42:00.470803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 727/1454] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:42:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:42:02.821400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f1a9-3805-42d6-bd27-855400e61107 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:42:02.821996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f1a9-3805-42d6-bd27-855400e61107 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:42:02.821996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f1a9-3805-42d6-bd27-855400e61107 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:42:02.823644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 728/1455] 10.222.0.18 () {54 vars in 926 bytes} [Mon Feb 28 18:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:42:02.830464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4160-f0ac-4d17-b207-cd98185be4db None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:42:02.831295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4160-f0ac-4d17-b207-cd98185be4db None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:42:02.831451 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a4160-f0ac-4d17-b207-cd98185be4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:42:02.860370 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a41a4160-f0ac-4d17-b207-cd98185be4db None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:42:02.861508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a41a4160-f0ac-4d17-b207-cd98185be4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:42:02.869701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 728/1456] 10.222.0.18 () {58 vars in 1023 bytes} [Mon Feb 28 18:42:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:42:02.908896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f1a9-3805-42d6-bd27-855400e61107 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:42:02.920722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f1a9-3805-42d6-bd27-855400e61107 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:42:02.924838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ee43c-8303-4ab5-b06a-08149f4bb410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:42:02.925398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee43c-8303-4ab5-b06a-08149f4bb410 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:42:02.925676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee43c-8303-4ab5-b06a-08149f4bb410 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:42:02.925952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ee43c-8303-4ab5-b06a-08149f4bb410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:42:02.934738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ee43c-8303-4ab5-b06a-08149f4bb410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:42:02.960993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ee43c-8303-4ab5-b06a-08149f4bb410 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:42:02.970930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 729/1457] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:42:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:43:13.910614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:13.911486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:13.911486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:13.942748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:43:13.943885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:43:13.952049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 729/1458] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:43:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:43:13.960391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:13.960916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:13.960916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:13.984967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:43:13.986104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:43:13.995106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 730/1459] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:43:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:43:14.002341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.016561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92873-2bf6-4ef0-99f6-bf7778f574fa None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.025076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.025602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.025883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.026168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.026911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:43:14.027209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.052593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.066862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 730/1460] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:43:14.075253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.084277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209df56b-bc61-40e1-bb5f-797080af9bfd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.090205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.091159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.091492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.091785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.092431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.117935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.163781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 731/1461] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:43:14 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:43:14.168204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.177744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4e72-8eee-4e58-9cea-96cd9958f3f1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.240617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.241268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.241549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.241820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.242462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.268408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.294487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 731/1462] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:43:14 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:43:14.299491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.309991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50d8f-1245-4ecb-974c-b4b1b8ec5b01 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.315044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf1448-cb9b-4abb-a3e1-535eb1a0c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.315647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1448-cb9b-4abb-a3e1-535eb1a0c4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.315934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1448-cb9b-4abb-a3e1-535eb1a0c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.316214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1448-cb9b-4abb-a3e1-535eb1a0c4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.316917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1448-cb9b-4abb-a3e1-535eb1a0c4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.342590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1448-cb9b-4abb-a3e1-535eb1a0c4c2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.353118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 732/1463] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:43:14.357782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.367815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0d28b-d28d-40dc-a8cc-062bb692d38b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.374167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.375344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.375714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.376115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] PATH_INFO: `/v3/projects/41874e34f51d429896a523c4af102603/users/486fce29e9584a668cd04fddf11af4f7/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.402067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41874e34f51d429896a523c4af102603, user_id=486fce29e9584a668cd04fddf11af4f7, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.427926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.448849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 732/1464] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:43:14 2022] PUT /identity/v3/projects/41874e34f51d429896a523c4af102603/users/486fce29e9584a668cd04fddf11af4f7/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:43:14.461678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee89de-23a4-4136-b2c8-aff0bc635f12 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.461973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee89de-23a4-4136-b2c8-aff0bc635f12 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.462273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee89de-23a4-4136-b2c8-aff0bc635f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.498241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e0ee89de-23a4-4136-b2c8-aff0bc635f12 None None] MFA Rules not processed for user `486fce29e9584a668cd04fddf11af4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:43:14.499423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e0ee89de-23a4-4136-b2c8-aff0bc635f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:43:14.572610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 733/1465] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:43:14 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:43:14.585666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.672876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ba68a-a3c3-47ca-b22b-9ecc8f2aad95 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.678044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.678651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.678906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.679185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.688054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.713198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.722440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 733/1466] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:43:14 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:43:14.798877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cad6a5-c9fb-42dc-8f88-d2de5558a6ab None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.799197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cad6a5-c9fb-42dc-8f88-d2de5558a6ab None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.799456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cad6a5-c9fb-42dc-8f88-d2de5558a6ab None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.801072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 734/1467] 10.222.0.18 () {52 vars in 829 bytes} [Mon Feb 28 18:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:43:14.804917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:14.884618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3982c4-6b49-4f3c-823f-3927bbb02cbd service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:14.889270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:14.890057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:14.890342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:14.890641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] PATH_INFO: `/v3/users/486fce29e9584a668cd04fddf11af4f7` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:14.891726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=486fce29e9584a668cd04fddf11af4f7)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:14.915923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:43:14.915923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:43:14.915923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:43:14.917109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:14.990191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486fce29e9584a668cd04fddf11af4f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.000386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486fce29e9584a668cd04fddf11af4f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.001256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486fce29e9584a668cd04fddf11af4f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.017814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486fce29e9584a668cd04fddf11af4f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.028193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486fce29e9584a668cd04fddf11af4f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.034327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 734/1468] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:43:14 2022] DELETE /identity/v3/users/486fce29e9584a668cd04fddf11af4f7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:43:15.039080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:15.039560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:15.039682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:15.064526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:43:15.065673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:43:15.135601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 735/1469] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:43:15.146300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:15.148842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:43:15.221295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9df3-7304-4d8a-82e6-8d1112d91d0f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:15.225194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b5ad-2bc5-4857-a178-4461ae630ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:15.225776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b5ad-2bc5-4857-a178-4461ae630ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:15.226064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b5ad-2bc5-4857-a178-4461ae630ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:15.226339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b5ad-2bc5-4857-a178-4461ae630ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:15.236110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b5ad-2bc5-4857-a178-4461ae630ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:15.261155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b5ad-2bc5-4857-a178-4461ae630ec2 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:15.271030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 735/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:43:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:43:15.724297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:43:15.725998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:43:15.741049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa21cc-0d1c-42ab-ae1f-0eda4330e1cc None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:43:15.745543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:43:15.746484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:43:15.747009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:43:15.747842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] PATH_INFO: `/v3/projects/41874e34f51d429896a523c4af102603` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:43:15.748988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41874e34f51d429896a523c4af102603)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:43:15.773816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:43:15.773816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:43:15.773816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:43:15.775057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:43:15.832392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41874e34f51d429896a523c4af102603', 'request_id': 'req-cfb235fe-65dd-401a-92dd-01aaef133409'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.837980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41874e34f51d429896a523c4af102603', 'request_id': 'req-cfb235fe-65dd-401a-92dd-01aaef133409'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.849222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41874e34f51d429896a523c4af102603', 'request_id': 'req-cfb235fe-65dd-401a-92dd-01aaef133409'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.865845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] The token cache is being invalidate because project 41874e34f51d429896a523c4af102603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:43:15.866129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.866788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cfb235fe-65dd-401a-92dd-01aaef133409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:43:15.868297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 736/1471] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:43:15 2022] DELETE /identity/v3/projects/41874e34f51d429896a523c4af102603 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:44:54.298157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d639d-df03-4ee4-ac48-ce97b0f1f2f6 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:54.298789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d639d-df03-4ee4-ac48-ce97b0f1f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:54.298945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d639d-df03-4ee4-ac48-ce97b0f1f2f6 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:54.301405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 736/1472] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:44:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 18:44:54.308272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa27eb-ea8a-4341-8591-863d68850f87 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:54.308837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa27eb-ea8a-4341-8591-863d68850f87 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:54.308837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa27eb-ea8a-4341-8591-863d68850f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:54.338861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cfaa27eb-ea8a-4341-8591-863d68850f87 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:44:54.340015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cfaa27eb-ea8a-4341-8591-863d68850f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:44:54.416428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 737/1473] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:44:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:44:54.568004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d639d-df03-4ee4-ac48-ce97b0f1f2f6 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:44:54.569771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-624d639d-df03-4ee4-ac48-ce97b0f1f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:44:54.685195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d639d-df03-4ee4-ac48-ce97b0f1f2f6 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:44:54.691125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf79b8-592d-4d04-932f-fde3263a5690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:44:54.691691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf79b8-592d-4d04-932f-fde3263a5690 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:54.691984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf79b8-592d-4d04-932f-fde3263a5690 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:54.692261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf79b8-592d-4d04-932f-fde3263a5690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:54.700420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf79b8-592d-4d04-932f-fde3263a5690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:44:54.726194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf79b8-592d-4d04-932f-fde3263a5690 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:44:54.736209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 737/1474] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:44:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:44:55.519134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aeca6-6d6d-48c8-83d3-192740fd7358 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:55.519697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aeca6-6d6d-48c8-83d3-192740fd7358 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:55.519697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aeca6-6d6d-48c8-83d3-192740fd7358 None None] PATH_INFO: `/v3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:55.520953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 738/1475] 10.222.0.70 () {54 vars in 925 bytes} [Mon Feb 28 18:44:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:44:55.529706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9adf9-ca1a-4ecf-bbfd-9b0a105d1e4e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:55.530113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9adf9-ca1a-4ecf-bbfd-9b0a105d1e4e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:55.530356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9adf9-ca1a-4ecf-bbfd-9b0a105d1e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:55.557011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cfc9adf9-ca1a-4ecf-bbfd-9b0a105d1e4e None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:44:55.558978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cfc9adf9-ca1a-4ecf-bbfd-9b0a105d1e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:44:55.637345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 738/1476] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Feb 28 18:44:55 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:44:56.131293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0116744-6e1f-4002-a49c-2b34f3a502f8 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:56.131584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0116744-6e1f-4002-a49c-2b34f3a502f8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:56.131980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0116744-6e1f-4002-a49c-2b34f3a502f8 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:56.134729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 739/1477] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:44:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:44:56.142812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6688-afaf-45b5-8907-21d2d39f59d2 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:56.143114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6688-afaf-45b5-8907-21d2d39f59d2 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:56.143497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb6688-afaf-45b5-8907-21d2d39f59d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:56.172519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dabb6688-afaf-45b5-8907-21d2d39f59d2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:44:56.173686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dabb6688-afaf-45b5-8907-21d2d39f59d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:44:56.182599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 739/1478] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:44:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:44:56.337211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0116744-6e1f-4002-a49c-2b34f3a502f8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:44:56.351294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0116744-6e1f-4002-a49c-2b34f3a502f8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:44:56.356462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398aef-d2f7-417a-b3ab-c5957617697f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:44:56.357049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398aef-d2f7-417a-b3ab-c5957617697f service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:56.357339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398aef-d2f7-417a-b3ab-c5957617697f service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:56.357624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398aef-d2f7-417a-b3ab-c5957617697f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:56.366835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22398aef-d2f7-417a-b3ab-c5957617697f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:44:56.393466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22398aef-d2f7-417a-b3ab-c5957617697f service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:44:56.403086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 740/1479] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:44:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:44:59.470028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d8a5a-bc72-4a73-8f05-a01b307ad4bc None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:59.470485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d8a5a-bc72-4a73-8f05-a01b307ad4bc None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:59.470621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d8a5a-bc72-4a73-8f05-a01b307ad4bc None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:59.472308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 740/1480] 10.222.0.18 () {54 vars in 960 bytes} [Mon Feb 28 18:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:44:59.477693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866deab1-1686-4de7-bfee-67058303c4e6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:59.478210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866deab1-1686-4de7-bfee-67058303c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:59.478321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866deab1-1686-4de7-bfee-67058303c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:59.501881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-866deab1-1686-4de7-bfee-67058303c4e6 None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:44:59.503079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-866deab1-1686-4de7-bfee-67058303c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:44:59.511487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 741/1481] 10.222.0.18 () {58 vars in 1057 bytes} [Mon Feb 28 18:44:59 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:44:59.519218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d8a5a-bc72-4a73-8f05-a01b307ad4bc None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:44:59.532578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d8a5a-bc72-4a73-8f05-a01b307ad4bc None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:44:59.537897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434d95f-ce33-4d27-a51e-3b79099d5fb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:44:59.538458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434d95f-ce33-4d27-a51e-3b79099d5fb6 service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:44:59.538775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434d95f-ce33-4d27-a51e-3b79099d5fb6 service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:44:59.539054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434d95f-ce33-4d27-a51e-3b79099d5fb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:44:59.547202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434d95f-ce33-4d27-a51e-3b79099d5fb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:44:59.574898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434d95f-ce33-4d27-a51e-3b79099d5fb6 service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:44:59.585807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 741/1482] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:44:59 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:45:08.228943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322338f7-6876-4a28-bcf0-dfd0eeb908a3 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:08.229438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322338f7-6876-4a28-bcf0-dfd0eeb908a3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:08.230229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322338f7-6876-4a28-bcf0-dfd0eeb908a3 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:08.231944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 742/1483] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:08.239663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088786-f052-4724-bae4-9a25b04c34b1 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:08.240106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088786-f052-4724-bae4-9a25b04c34b1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:08.240217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088786-f052-4724-bae4-9a25b04c34b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:08.266491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-0b088786-f052-4724-bae4-9a25b04c34b1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:08.267654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0b088786-f052-4724-bae4-9a25b04c34b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:08.275861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 742/1484] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:45:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:45:08.427117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322338f7-6876-4a28-bcf0-dfd0eeb908a3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:45:08.444574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322338f7-6876-4a28-bcf0-dfd0eeb908a3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:45:08.450356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d258-e1a5-4afb-9dfa-988d1ff62da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:45:08.450963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d258-e1a5-4afb-9dfa-988d1ff62da3 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:08.451254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d258-e1a5-4afb-9dfa-988d1ff62da3 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:08.451533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d258-e1a5-4afb-9dfa-988d1ff62da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:08.459862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032d258-e1a5-4afb-9dfa-988d1ff62da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:45:08.485178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032d258-e1a5-4afb-9dfa-988d1ff62da3 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:45:08.494081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 743/1485] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:45:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:45:09.892031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4e80-45b3-4a57-9265-a41038972a56 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:09.892569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4e80-45b3-4a57-9265-a41038972a56 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:09.892569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4e80-45b3-4a57-9265-a41038972a56 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:09.894268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 18:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:09.900331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811404aa-9d0e-4d8b-acbb-ac095c99404f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:09.901196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811404aa-9d0e-4d8b-acbb-ac095c99404f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:09.901386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811404aa-9d0e-4d8b-acbb-ac095c99404f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:09.926391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-811404aa-9d0e-4d8b-acbb-ac095c99404f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:09.927481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-811404aa-9d0e-4d8b-acbb-ac095c99404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:09.937072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 18:45:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:45:10.092592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4e80-45b3-4a57-9265-a41038972a56 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:45:10.108376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4e80-45b3-4a57-9265-a41038972a56 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:45:10.113338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d4dc-4112-436e-9065-c85d7bc58c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:45:10.113931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d4dc-4112-436e-9065-c85d7bc58c9a service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:10.114217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d4dc-4112-436e-9065-c85d7bc58c9a service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:10.114494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d4dc-4112-436e-9065-c85d7bc58c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:10.122672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91d4dc-4112-436e-9065-c85d7bc58c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:45:10.147857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91d4dc-4112-436e-9065-c85d7bc58c9a service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:45:10.156991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 744/1488] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:45:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:45:14.031549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c617-f835-49cb-9e33-f3ea8d119626 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:14.032453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c617-f835-49cb-9e33-f3ea8d119626 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:14.032453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663c617-f835-49cb-9e33-f3ea8d119626 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:14.035350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:45:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:14.043297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266918c0-e098-48b3-88db-cde40fd3b36d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:14.043775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266918c0-e098-48b3-88db-cde40fd3b36d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:14.043881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266918c0-e098-48b3-88db-cde40fd3b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:14.067747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-266918c0-e098-48b3-88db-cde40fd3b36d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:14.068883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-266918c0-e098-48b3-88db-cde40fd3b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:14.077238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:45:14.113628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c617-f835-49cb-9e33-f3ea8d119626 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:45:14.116510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2663c617-f835-49cb-9e33-f3ea8d119626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:14.192042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663c617-f835-49cb-9e33-f3ea8d119626 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:45:14.196363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e648ee-e595-4797-bfc1-023ad780a65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:45:14.196951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e648ee-e595-4797-bfc1-023ad780a65e service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:14.197230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e648ee-e595-4797-bfc1-023ad780a65e service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:14.197488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e648ee-e595-4797-bfc1-023ad780a65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:14.207565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e648ee-e595-4797-bfc1-023ad780a65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:45:14.232677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e648ee-e595-4797-bfc1-023ad780a65e service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:45:14.242868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 746/1491] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:45:16.225433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad6551-5ff7-4c15-a3e0-cba29111f790 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:16.225989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad6551-5ff7-4c15-a3e0-cba29111f790 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:16.225989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad6551-5ff7-4c15-a3e0-cba29111f790 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:16.228327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:16.236282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acae5d-932b-472a-a508-66e15c9df991 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:16.237023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acae5d-932b-472a-a508-66e15c9df991 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:16.237202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acae5d-932b-472a-a508-66e15c9df991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:16.269085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-26acae5d-932b-472a-a508-66e15c9df991 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:16.270224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-26acae5d-932b-472a-a508-66e15c9df991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:16.278743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:45:16.315168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad6551-5ff7-4c15-a3e0-cba29111f790 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:45:16.329965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad6551-5ff7-4c15-a3e0-cba29111f790 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:45:16.333935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f493f7e-ded0-48bf-a211-b4661528ff46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:45:16.334508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493f7e-ded0-48bf-a211-b4661528ff46 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:16.334830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493f7e-ded0-48bf-a211-b4661528ff46 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:16.335108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493f7e-ded0-48bf-a211-b4661528ff46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:16.344814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493f7e-ded0-48bf-a211-b4661528ff46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:45:16.369972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493f7e-ded0-48bf-a211-b4661528ff46 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:45:16.379824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 747/1494] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:45:19.943079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a002-4efa-45c0-ab77-2c415725b4ed None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:19.943660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a002-4efa-45c0-ab77-2c415725b4ed None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:19.943660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a002-4efa-45c0-ab77-2c415725b4ed None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:19.945331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:19.952309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179836f-7459-4e28-b9ca-53a7351c0e9a None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:19.953076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179836f-7459-4e28-b9ca-53a7351c0e9a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:19.953253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179836f-7459-4e28-b9ca-53a7351c0e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:19.984809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b179836f-7459-4e28-b9ca-53a7351c0e9a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:19.985958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b179836f-7459-4e28-b9ca-53a7351c0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:19.993450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:45:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:45:20.054665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a002-4efa-45c0-ab77-2c415725b4ed None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:45:20.056667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f4d4a002-4efa-45c0-ab77-2c415725b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:20.123160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a002-4efa-45c0-ab77-2c415725b4ed None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:45:20.128639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c664d2-e9e5-4835-a0fa-b983f9a0e814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:45:20.129479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c664d2-e9e5-4835-a0fa-b983f9a0e814 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:20.129846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c664d2-e9e5-4835-a0fa-b983f9a0e814 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:20.130218 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c664d2-e9e5-4835-a0fa-b983f9a0e814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:20.144806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c664d2-e9e5-4835-a0fa-b983f9a0e814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:45:20.172546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c664d2-e9e5-4835-a0fa-b983f9a0e814 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:45:20.181962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 749/1497] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:45:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:45:22.188698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80765-db59-4f71-a4f0-c5a92412f7f1 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:22.189223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80765-db59-4f71-a4f0-c5a92412f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:22.189223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80765-db59-4f71-a4f0-c5a92412f7f1 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:22.191900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 18:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:22.197168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cdfb-a276-465e-bf1e-b1f11d1a2224 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:22.197659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cdfb-a276-465e-bf1e-b1f11d1a2224 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:22.197741 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cdfb-a276-465e-bf1e-b1f11d1a2224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:22.222312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ed12cdfb-a276-465e-bf1e-b1f11d1a2224 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:22.223459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ed12cdfb-a276-465e-bf1e-b1f11d1a2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:22.231451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 18:45:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:45:22.294191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef2a8-8af1-4b40-b323-8c6d546ed118 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:22.294440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef2a8-8af1-4b40-b323-8c6d546ed118 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:22.294768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef2a8-8af1-4b40-b323-8c6d546ed118 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:22.296467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 750/1500] 10.222.0.18 () {54 vars in 962 bytes} [Mon Feb 28 18:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:45:22.301498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724213e-4a5e-4d48-968a-019febbd84ae None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:22.301794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724213e-4a5e-4d48-968a-019febbd84ae None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:22.302074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724213e-4a5e-4d48-968a-019febbd84ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:22.325653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a724213e-4a5e-4d48-968a-019febbd84ae None None] MFA Rules not processed for user `d60d7d7120b047c5b45fb922c8063048`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:45:22.327143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a724213e-4a5e-4d48-968a-019febbd84ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:45:22.334189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 751/1501] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Feb 28 18:45:22 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:45:22.342271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef2a8-8af1-4b40-b323-8c6d546ed118 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:45:22.354760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef2a8-8af1-4b40-b323-8c6d546ed118 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:45:22.360053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8520d-8749-485e-b7bb-30b044b8b6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:45:22.360918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8520d-8749-485e-b7bb-30b044b8b6ac service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:45:22.361346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8520d-8749-485e-b7bb-30b044b8b6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:45:22.361725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8520d-8749-485e-b7bb-30b044b8b6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:45:22.375091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8520d-8749-485e-b7bb-30b044b8b6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:45:22.400538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8520d-8749-485e-b7bb-30b044b8b6ac service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:45:22.410702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 751/1502] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:45:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:53.314745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60ddc-cee9-4d9c-83f0-22dc685c9a80 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.317817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d317a-6f97-4bcd-9434-70c92409343d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.318913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d317a-6f97-4bcd-9434-70c92409343d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.319639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60ddc-cee9-4d9c-83f0-22dc685c9a80 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.320572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d317a-6f97-4bcd-9434-70c92409343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.321149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60ddc-cee9-4d9c-83f0-22dc685c9a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.381607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-952d317a-6f97-4bcd-9434-70c92409343d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.383229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-952d317a-6f97-4bcd-9434-70c92409343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.386293 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cae60ddc-cee9-4d9c-83f0-22dc685c9a80 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.387422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cae60ddc-cee9-4d9c-83f0-22dc685c9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.397674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 752/1503] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.402695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777644ec-c7d9-4162-a5d7-f4767c4cacae None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.403237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777644ec-c7d9-4162-a5d7-f4767c4cacae None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.403727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777644ec-c7d9-4162-a5d7-f4767c4cacae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.406630 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 752/1504] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.407897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d371c56-035a-40f4-badb-fd561f217352 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.408190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d371c56-035a-40f4-badb-fd561f217352 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.408476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d371c56-035a-40f4-badb-fd561f217352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.439030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-777644ec-c7d9-4162-a5d7-f4767c4cacae None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.441362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-777644ec-c7d9-4162-a5d7-f4767c4cacae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.450082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 753/1505] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.451622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda192b-9cc8-4863-8b57-23ae4ee1876b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.452117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda192b-9cc8-4863-8b57-23ae4ee1876b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.452616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda192b-9cc8-4863-8b57-23ae4ee1876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.463629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1d371c56-035a-40f4-badb-fd561f217352 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.464789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1d371c56-035a-40f4-badb-fd561f217352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.485282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8eda192b-9cc8-4863-8b57-23ae4ee1876b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.487103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8eda192b-9cc8-4863-8b57-23ae4ee1876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.492403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 753/1506] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.493775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d444-7e48-4e54-9ce6-50a64ce56ac8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.494071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d444-7e48-4e54-9ce6-50a64ce56ac8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.494352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d444-7e48-4e54-9ce6-50a64ce56ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.498215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 754/1507] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.500417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9fc2-2eac-481d-a000-0d79056de5a2 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.500999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9fc2-2eac-481d-a000-0d79056de5a2 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.501491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd9fc2-2eac-481d-a000-0d79056de5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.524324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a6e1d444-7e48-4e54-9ce6-50a64ce56ac8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.525454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a6e1d444-7e48-4e54-9ce6-50a64ce56ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.527222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1cfd9fc2-2eac-481d-a000-0d79056de5a2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.528315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1cfd9fc2-2eac-481d-a000-0d79056de5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.532300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 754/1508] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.533647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.534050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.534507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.535765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 755/1509] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.536622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.536907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.537184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.560190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.561363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.561699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.562917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.568533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 755/1510] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.569283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.570474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 756/1511] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.575665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.578491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d2736-e58b-4a99-bba8-1b0217d9d177 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.582897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.583488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.583773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.584050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.584730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:53.585029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.587925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866878-e3e0-45b9-ace0-4e44e8c629cb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.592457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.593029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.593305 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.593585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.594262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:53.594583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.610216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4289-019f-456f-95cb-f4218413aa94 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.620293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0caeb6-7dd2-4828-b964-6d173cb6ceaf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.623578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 756/1512] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:53.624757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.625026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.625303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.633990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 757/1513] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:53.635458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf5b3-f813-4569-8877-b0c66089a719 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.635622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf5b3-f813-4569-8877-b0c66089a719 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.635886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf5b3-f813-4569-8877-b0c66089a719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.647268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.648427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.655363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 757/1514] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.656109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.658322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-820cf5b3-f813-4569-8877-b0c66089a719 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.659557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-820cf5b3-f813-4569-8877-b0c66089a719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.666882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 758/1515] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.668109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3883-fdc9-4a5d-97d8-1ed217f36f3d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.668465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3883-fdc9-4a5d-97d8-1ed217f36f3d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.668809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3883-fdc9-4a5d-97d8-1ed217f36f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.677992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328248a-9e90-49ec-bd1f-29bf09904849 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.682617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.683224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.683502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.683776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.684462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:53.684754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.691464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-abff3883-fdc9-4a5d-97d8-1ed217f36f3d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.692656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-abff3883-fdc9-4a5d-97d8-1ed217f36f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.700786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 759/1516] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.703803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.703803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.703803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.711175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907405b5-2673-4301-a932-f283fe252da1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.725150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.726109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 758/1517] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:53.726322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.727351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.727650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.727893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.738764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 760/1518] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.739516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.748189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a6f93-736c-439f-85d1-0040b37010bc None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.752282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dae5ff-3f27-45bc-9bbd-d4bfa814e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.753460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae5ff-3f27-45bc-9bbd-d4bfa814e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.753751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae5ff-3f27-45bc-9bbd-d4bfa814e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.754028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae5ff-3f27-45bc-9bbd-d4bfa814e3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.754583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.754710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dae5ff-3f27-45bc-9bbd-d4bfa814e3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.755728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.763642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 759/1519] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.764335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.773367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55828a7-b5fa-4f17-b142-4269528f244d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.777780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dde6fc-2cf1-42b8-a122-1ce11915aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.778355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde6fc-2cf1-42b8-a122-1ce11915aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.778678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde6fc-2cf1-42b8-a122-1ce11915aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.778959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde6fc-2cf1-42b8-a122-1ce11915aaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.779594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dde6fc-2cf1-42b8-a122-1ce11915aaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.780391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dae5ff-3f27-45bc-9bbd-d4bfa814e3ce admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.806161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dde6fc-2cf1-42b8-a122-1ce11915aaa8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.809031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 761/1520] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:53.810265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.810567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.810856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.834177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 760/1521] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:53.834769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.835461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.835748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.836030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.836142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.858760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:53.860161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:53.901666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 762/1522] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.902506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.911516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef088a-fb4a-4b3c-8ee6-fc0c8439ed90 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.915623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.916197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.916482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.916759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.917444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:53.917741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.925658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 761/1523] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:53.926575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.935091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b09d04-aa7c-4ee1-8d10-351e664baea0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.939775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.941061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.941442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.941708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.942360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.943371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.956990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 763/1524] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:53.957570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:53.966298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b406d02-57b1-4fb2-9d56-41f8003defe6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:53.970501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:53.971121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:53.971405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:53.971677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:53.972372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:53.972664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:53.975933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:53.997779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.004519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 762/1525] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.005263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.021014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 764/1526] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:54.021014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.023536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3f6af-1be7-4699-aded-09692d57e310 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.071968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b1698-3563-49d2-a883-513d882cb1cf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.076850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.077469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.077762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.078049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.078796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:54.079096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.085916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.086532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.086921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.087200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.087840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.104548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.113263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.118157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 763/1527] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:54.119118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.129126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99163a-f33b-4aa9-a075-346238c777ac admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.134660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.135266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.135563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.135848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.136728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.138331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 765/1528] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.139177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.149893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed27a5f-6b9e-4b00-ad44-59df53b6ccb5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.154263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.154858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.155141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.155421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.156098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:54.156394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.162988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.181661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.184096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 764/1529] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.184996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.195753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 766/1530] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:54.196549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.196903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786fcb-582a-45df-9285-d8ee3b515310 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.206885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.207573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.207929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.208305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.209067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:46:54.209437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.210587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cf67-6752-4c9a-9d15-e83f3b3067dc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.214760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.215335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.215615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.215885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.216522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.235946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.242252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.249809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 765/1531] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:46:54.250793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.260139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c9f4-e9d1-406f-8614-e5d87f3b2246 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.264574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.265190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.265545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.265842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.266545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.275998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 767/1532] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.276867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.292605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.314062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 766/1533] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.317492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.327167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6f1ea-784b-4e01-a19b-ee4be8f62e8b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.345477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa095b-515c-44c4-ac1f-82aaec5c532d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.350788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.351393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.351683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.351972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.352653 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.378116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.396006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.396708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.397004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.397286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.397931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.407939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 768/1534] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.407939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.423863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.456838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 767/1535] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.456838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.477136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe62f1-6b34-41fd-ad57-a758c8284773 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.526036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ded788-5d7a-4384-b041-725aed5d3112 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.531775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.532392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.532700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.533000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.533781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.544669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.545307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.545598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.545883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.546618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.559315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.570403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 768/1536] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:54.571331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.572374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.582190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e97487-35d6-4354-80fa-8290482d7475 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.583562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 769/1537] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:54.584335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.587402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.587991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.588277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.588570 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.589201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.593541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d96f-343a-45a7-9151-eb17ad89ff4e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.597825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.598396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.598717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.599002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.599631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.615607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.625262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.645044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 769/1538] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.645989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.657903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 770/1539] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.657903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.713890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76295a5e-c1d8-4158-a6f7-75ca20b0cd9a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.727375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946d4b6-fc86-414f-a58e-67d03b8f6e49 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.731578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.732240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.732523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.732786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.733492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.759968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.771076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 771/1540] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:54.771960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.780519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.781115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.781403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.781678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.782312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.782982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d9a15-22d6-41fa-ac5c-6e5c9a7d4e72 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.787311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.787898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.788182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.788468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.789082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.808899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.814545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.834347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 770/1541] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.835300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.838646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 772/1542] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 287 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.839426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.845147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02487a-d072-4a36-aad1-5a8c89135116 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.848536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f02979-2097-443b-a199-8d77aad9fa77 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.850277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.851124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.851418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.851700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.852337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.852721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.853524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.853810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.854095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] PATH_INFO: `/v3/projects/bbff699f8ada48a78f3957fe6718a4ad/users/45a491cd7bb8422fb6e3ee727d7b15f7/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.874837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbff699f8ada48a78f3957fe6718a4ad, user_id=45a491cd7bb8422fb6e3ee727d7b15f7, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.878096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.899157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 771/1543] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:54.900259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.900530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:54.913056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff42b0d-371d-4720-8941-7bf6d06e8fc1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.917360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 773/1544] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:54 2022] PUT /identity/v3/projects/bbff699f8ada48a78f3957fe6718a4ad/users/45a491cd7bb8422fb6e3ee727d7b15f7/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:54.918131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:54.977879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.978756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.979046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.979326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] PATH_INFO: `/v3/projects/6c9c9337657d43f59f92137cbfb4bdcb/users/6b707673c1614cb59683ffa0810cc6a0/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.984654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c917-50ad-40e4-9b10-84981c2fc520 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:54.989413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:54.990062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:54.990350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:54.990649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:54.991284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:54.998138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9c9337657d43f59f92137cbfb4bdcb, user_id=6b707673c1614cb59683ffa0810cc6a0, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.016779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.024659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.039216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 774/1545] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:54 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:55.039945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.040657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 772/1546] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:54 2022] PUT /identity/v3/projects/6c9c9337657d43f59f92137cbfb4bdcb/users/6b707673c1614cb59683ffa0810cc6a0/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.041471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.052542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2d269-18cd-4b23-9560-d29371b23e3e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.112852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d6f0-73b8-4040-8fd8-df8890b8b7f1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.116381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.117051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.117362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.117681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.118251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.118471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.119182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.119466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.119758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] PATH_INFO: `/v3/projects/257851b949234252b54d9524d8ffca6d/users/257daff704df4c1a950ecf9008d0f224/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.141025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257851b949234252b54d9524d8ffca6d, user_id=257daff704df4c1a950ecf9008d0f224, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.145435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.168431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 775/1547] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:55 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:55.168617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.168704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.178110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e150f-a2ee-4ef1-b752-0678d2ffb601 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.183575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 773/1548] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:55 2022] PUT /identity/v3/projects/257851b949234252b54d9524d8ffca6d/users/257daff704df4c1a950ecf9008d0f224/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.184251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.248185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.248901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.249191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.249473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.250175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.256107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f6b2d-62ca-4d29-ba3a-a3ea26717116 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.260430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b348420-e41f-49e1-82a4-dc83dd7daf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.261029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b348420-e41f-49e1-82a4-dc83dd7daf15 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.261315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b348420-e41f-49e1-82a4-dc83dd7daf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.261595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b348420-e41f-49e1-82a4-dc83dd7daf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.262292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b348420-e41f-49e1-82a4-dc83dd7daf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.275849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.286333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 776/1549] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:55.287168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.288211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b348420-e41f-49e1-82a4-dc83dd7daf15 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.296313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1fbd7-ceda-4216-a377-de5b161aff32 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.298870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 774/1550] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:55.300290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.300551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.300856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.303893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ff59a-c5da-4686-821d-042c36905e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.304485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ff59a-c5da-4686-821d-042c36905e45 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.304774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ff59a-c5da-4686-821d-042c36905e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.305055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ff59a-c5da-4686-821d-042c36905e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.305747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ff59a-c5da-4686-821d-042c36905e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.322358 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:55.323861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:55.331322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 775/1551] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:55.331723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ff59a-c5da-4686-821d-042c36905e45 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.332313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.342820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 777/1552] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:55.344090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.344251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d9c54-d385-494c-97c8-213a0c7893cf None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.344368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.344641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.350918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d5e7f-209a-4f36-a868-1fe09f223c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.351515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5e7f-209a-4f36-a868-1fe09f223c5c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.351803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5e7f-209a-4f36-a868-1fe09f223c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.352081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d5e7f-209a-4f36-a868-1fe09f223c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.352774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5e7f-209a-4f36-a868-1fe09f223c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.367809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:55.368981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:55.375788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 778/1553] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:55.376541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.377857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d5e7f-209a-4f36-a868-1fe09f223c5c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.385389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d68c9-c0b8-4279-b393-a3a3c1d89c95 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.389080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 776/1554] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:55.389821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.390359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752e9a-c749-48cf-919d-57452335883f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.390479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.390689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752e9a-c749-48cf-919d-57452335883f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.390818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.391000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752e9a-c749-48cf-919d-57452335883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.391108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.391691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.413204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cc752e9a-c749-48cf-919d-57452335883f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:55.414351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cc752e9a-c749-48cf-919d-57452335883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:55.416914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.426540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 777/1555] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:55.427636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc752e9a-c749-48cf-919d-57452335883f None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.428008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 779/1556] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:55.428788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.441494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc752e9a-c749-48cf-919d-57452335883f None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.441684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1259f-353a-4a4b-a812-7738e2c32fa1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.446045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.446219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.446895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.447019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.447181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.447292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.447453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] PATH_INFO: `/v3/projects/fa753859778c44c5bf4fe483dc278775/users/dad616a8c2c842f8bafc32c30a719a5e/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.447550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] PATH_INFO: `/v3/projects/726c24ca1e8e4efc951e601606096221/users/00e2342ffaa347ea9948d3b0ed19feef/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.467275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726c24ca1e8e4efc951e601606096221, user_id=00e2342ffaa347ea9948d3b0ed19feef, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.467480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa753859778c44c5bf4fe483dc278775, user_id=dad616a8c2c842f8bafc32c30a719a5e, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.493220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.493386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.508983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 780/1557] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:55 2022] PUT /identity/v3/projects/fa753859778c44c5bf4fe483dc278775/users/dad616a8c2c842f8bafc32c30a719a5e/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.517168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 778/1558] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:55 2022] PUT /identity/v3/projects/726c24ca1e8e4efc951e601606096221/users/00e2342ffaa347ea9948d3b0ed19feef/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.517330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.517444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.586132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cbf4e-3fe9-443f-9fca-467704a2037f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.598933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e9797-6f2e-40aa-a411-4c0ef9f8dfd6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.604227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.605059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.605355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.605646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] PATH_INFO: `/v3/projects/8fcb1c7fbee84c74815b0b125d1f9b35/users/b29711f9ca2e4725b4f702405eb31bd3/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.624722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcb1c7fbee84c74815b0b125d1f9b35, user_id=b29711f9ca2e4725b4f702405eb31bd3, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.644155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.644731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.645009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.645290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.651589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.654520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.666443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 779/1559] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:55 2022] PUT /identity/v3/projects/8fcb1c7fbee84c74815b0b125d1f9b35/users/b29711f9ca2e4725b4f702405eb31bd3/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.667307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.680238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.689628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 781/1560] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:55.690440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.699093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161b1c-40c1-45c0-a34d-b391b0299316 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.742204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba603a30-8602-4988-a2fa-2322dfcfc513 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.745594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.746262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.746549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.746857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.828656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.854105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.854805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.854939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.855203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.855544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] PATH_INFO: `/v3/projects/892e009800754f2e804106e693211cf4/users/7ab0c4b4cdb94138bb8bdfeb77cdbff8/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.865118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 780/1561] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:55.865915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.875165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad170ca-3a1d-47b9-ae2e-2b30ebd040b3 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:55.876018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=892e009800754f2e804106e693211cf4, user_id=7ab0c4b4cdb94138bb8bdfeb77cdbff8, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.879783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748bef-efb0-4a93-811b-21353ada9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:55.880780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748bef-efb0-4a93-811b-21353ada9e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.881074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748bef-efb0-4a93-811b-21353ada9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.881347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748bef-efb0-4a93-811b-21353ada9e24 admin admin] PATH_INFO: `/v3/projects/2dde676ebfae458485b906516863f0a6/users/f038a4a281c04d9b9b81caa376c2db71/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.902811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.904034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748bef-efb0-4a93-811b-21353ada9e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dde676ebfae458485b906516863f0a6, user_id=f038a4a281c04d9b9b81caa376c2db71, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:55.918736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 782/1562] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:55 2022] PUT /identity/v3/projects/892e009800754f2e804106e693211cf4/users/7ab0c4b4cdb94138bb8bdfeb77cdbff8/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.923621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:55.932842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748bef-efb0-4a93-811b-21353ada9e24 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:55.953469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 781/1563] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:55 2022] PUT /identity/v3/projects/2dde676ebfae458485b906516863f0a6/users/f038a4a281c04d9b9b81caa376c2db71/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:55.955676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa210056-cc7b-4215-b325-6299e03d57a2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:55.956120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa210056-cc7b-4215-b325-6299e03d57a2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:55.956922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa210056-cc7b-4215-b325-6299e03d57a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:55.995468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-aa210056-cc7b-4215-b325-6299e03d57a2 None None] MFA Rules not processed for user `00e2342ffaa347ea9948d3b0ed19feef`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:55.996839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-aa210056-cc7b-4215-b325-6299e03d57a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.009429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde84f4-4c54-423b-ab6c-288fc35baa2e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.069096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c3028-3d22-4081-9683-b26c2b285bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.069685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3028-3d22-4081-9683-b26c2b285bab service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.069973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3028-3d22-4081-9683-b26c2b285bab service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.070253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3028-3d22-4081-9683-b26c2b285bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.088047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 782/1564] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3710 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.089716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b0ddb-53ae-4e6a-bd4f-ecd26e66717a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.090165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b0ddb-53ae-4e6a-bd4f-ecd26e66717a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.090599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b0ddb-53ae-4e6a-bd4f-ecd26e66717a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.129501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5f5b0ddb-53ae-4e6a-bd4f-ecd26e66717a None None] MFA Rules not processed for user `dad616a8c2c842f8bafc32c30a719a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:56.130486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5f5b0ddb-53ae-4e6a-bd4f-ecd26e66717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.144606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c3028-3d22-4081-9683-b26c2b285bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.175353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c3028-3d22-4081-9683-b26c2b285bab service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.188432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 783/1565] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:56.190526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9eb1-5ef2-440d-9a3d-2e7ed6d0f6e2 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.191012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9eb1-5ef2-440d-9a3d-2e7ed6d0f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.191432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9eb1-5ef2-440d-9a3d-2e7ed6d0f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.210016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 783/1566] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.211532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f50d6-a5a2-4990-8051-69ae92f68bf5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.211901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f50d6-a5a2-4990-8051-69ae92f68bf5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.212257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f50d6-a5a2-4990-8051-69ae92f68bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.225030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d21d9eb1-5ef2-440d-9a3d-2e7ed6d0f6e2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:56.226234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d21d9eb1-5ef2-440d-9a3d-2e7ed6d0f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.240107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 784/1567] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.241812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.242193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.242530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.250477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c41f50d6-a5a2-4990-8051-69ae92f68bf5 None None] MFA Rules not processed for user `7ab0c4b4cdb94138bb8bdfeb77cdbff8`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:56.251727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c41f50d6-a5a2-4990-8051-69ae92f68bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.268775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:56.269943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.280475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 785/1568] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.280475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.288944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea60e6-4047-42ab-885c-ee200e0ef3d1 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.293527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.294138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.294425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.294744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.295408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.321670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.332860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 784/1569] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.335345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5ce7-fd09-4596-9499-1bd09a3d0d46 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.336402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5ce7-fd09-4596-9499-1bd09a3d0d46 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.336919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5ce7-fd09-4596-9499-1bd09a3d0d46 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.348308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 785/1570] 10.222.0.18 () {54 vars in 959 bytes} [Mon Feb 28 18:46:56 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:46:56.349160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5ce7-fd09-4596-9499-1bd09a3d0d46 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.351204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-233f5ce7-fd09-4596-9499-1bd09a3d0d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.353687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 786/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:56.354773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.358297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.428408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee0ae-6801-45af-a70d-3805604da46b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.431981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.432574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.432861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.433168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.450319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5ce7-fd09-4596-9499-1bd09a3d0d46 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.457442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb674383-2532-40f5-b7df-dff88364914a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.459217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb674383-2532-40f5-b7df-dff88364914a service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.459684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb674383-2532-40f5-b7df-dff88364914a service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.460110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb674383-2532-40f5-b7df-dff88364914a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.548715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb674383-2532-40f5-b7df-dff88364914a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.567602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.584559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb674383-2532-40f5-b7df-dff88364914a service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.595789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 786/1572] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:56.597491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b04745-05a7-4450-9740-9751db782256 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.597814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b04745-05a7-4450-9740-9751db782256 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.598001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b04745-05a7-4450-9740-9751db782256 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.600012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 787/1573] 10.222.0.18 () {54 vars in 959 bytes} [Mon Feb 28 18:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:46:56.601048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece77af-b2da-4e4c-9ab4-cb9a0031c82f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.601467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece77af-b2da-4e4c-9ab4-cb9a0031c82f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.601835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece77af-b2da-4e4c-9ab4-cb9a0031c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.626521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9ece77af-b2da-4e4c-9ab4-cb9a0031c82f None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:56.627926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9ece77af-b2da-4e4c-9ab4-cb9a0031c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.652532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.676908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 787/1574] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:56.678297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.696776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae7b8-ab87-465f-b046-67742c398a5e service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.702459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.703568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.704074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.704437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.705937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.711253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 788/1575] 10.222.0.18 () {58 vars in 1056 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.712858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.713251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.713829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.735903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.738276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:56.739610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:56.752590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 789/1576] 10.222.0.18 () {58 vars in 1056 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:56.753641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.774131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 788/1577] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:46:56 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:46:56.776225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.776676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4474e-783e-412a-92cf-a75ddff167e0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.789548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.789934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.790225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.790546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.794801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6968-2f41-4691-a770-c9caad385d53 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.801555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.802504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.803104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.803542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.883842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.887935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.911165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.918980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.922111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 790/1578] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:56.923147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:56.938498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe6e05-d13c-4be7-81e3-839b919919e1 service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:56.942415 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 789/1579] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:56.943966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:56.944776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:56.945142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:56.945425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:56.946187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:56.973679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:56.986350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 791/1580] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:56.990682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.002905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1e0b-926c-4de4-89f5-986f83a538fd service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.007333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.008161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.008446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.008829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] PATH_INFO: `/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340/users/cb3721a9cd9c4d0f961fe660f8b80730/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.030970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff9019ac4984c1bbc15f1b5308e0340, user_id=cb3721a9cd9c4d0f961fe660f8b80730, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.061021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.081549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 790/1581] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:56 2022] PUT /identity/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340/users/cb3721a9cd9c4d0f961fe660f8b80730/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:57.082655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.092622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbbd2-b3ba-4bba-8e48-1b1fba748aa4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.185744 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.186728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.187226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.187702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.188617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.221085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.235756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 792/1582] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:57.241048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.255394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe9e0b-0833-43c0-8a89-d3b52549fabf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.265719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.269796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.270098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.270683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] PATH_INFO: `/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340/users/cb3721a9cd9c4d0f961fe660f8b80730/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.275957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff9019ac4984c1bbc15f1b5308e0340, user_id=cb3721a9cd9c4d0f961fe660f8b80730, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.346162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.360381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 791/1583] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:57 2022] PUT /identity/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340/users/cb3721a9cd9c4d0f961fe660f8b80730/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:57.361872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.407759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fb98e-c449-4abc-bef1-ba7c666674d5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.520974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.521638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.521926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.522205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.522938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.557757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.564296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.587054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 793/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:46:57.588502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.679418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c8dd-417e-48aa-a733-dfd07e07f1fd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.684675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.685526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.685839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.686191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.691703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adbcff-c207-420f-bfc3-1c8c26e5e77c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.696805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276bb0c-ff06-476e-adef-7ed4d40e6ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.697399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276bb0c-ff06-476e-adef-7ed4d40e6ebe service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.698060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276bb0c-ff06-476e-adef-7ed4d40e6ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.698332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276bb0c-ff06-476e-adef-7ed4d40e6ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.821047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.864298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276bb0c-ff06-476e-adef-7ed4d40e6ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.879495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.894975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 794/1585] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:57.896172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:57.908187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8af1b-3d01-4657-9bcf-5d2fcbbd6ec1 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:57.914442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaa9d6-6dbb-470e-af8d-d9e2a31aea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:57.915532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaa9d6-6dbb-470e-af8d-d9e2a31aea23 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.916057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaa9d6-6dbb-470e-af8d-d9e2a31aea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.916445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaa9d6-6dbb-470e-af8d-d9e2a31aea23 admin admin] PATH_INFO: `/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340/users/cb3721a9cd9c4d0f961fe660f8b80730/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:57.918791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaa9d6-6dbb-470e-af8d-d9e2a31aea23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff9019ac4984c1bbc15f1b5308e0340, user_id=cb3721a9cd9c4d0f961fe660f8b80730, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:57.923333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276bb0c-ff06-476e-adef-7ed4d40e6ebe service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.955945 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaa9d6-6dbb-470e-af8d-d9e2a31aea23 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:57.958149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 792/1586] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:57.977626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 795/1587] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:46:57 2022] PUT /identity/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340/users/cb3721a9cd9c4d0f961fe660f8b80730/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:57.988069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:57.989079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:57.989453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.046443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8598f9-ad83-40b8-87ef-eba180bfc0de None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:58.046954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8598f9-ad83-40b8-87ef-eba180bfc0de None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:58.047409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8598f9-ad83-40b8-87ef-eba180bfc0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.079253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] MFA Rules not processed for user `cb3721a9cd9c4d0f961fe660f8b80730`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:58.080836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:58.123504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-da8598f9-ad83-40b8-87ef-eba180bfc0de None None] MFA Rules not processed for user `257daff704df4c1a950ecf9008d0f224`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:58.124702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-da8598f9-ad83-40b8-87ef-eba180bfc0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:58.204089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 793/1588] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:57 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:58.257329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:58.316123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 796/1589] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:58.321337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a788d-30bb-46b2-bb5c-6253752baf0d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:58.321633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a788d-30bb-46b2-bb5c-6253752baf0d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:58.321916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a788d-30bb-46b2-bb5c-6253752baf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.370814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f77a788d-30bb-46b2-bb5c-6253752baf0d None None] MFA Rules not processed for user `257daff704df4c1a950ecf9008d0f224`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:58.373070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f77a788d-30bb-46b2-bb5c-6253752baf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:58.391308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 797/1590] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:58.428849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cd16-86db-458b-9353-4690efbf75a7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:58.437572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa2c41-8cef-4b65-9d59-d15dbf204b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:58.440169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa2c41-8cef-4b65-9d59-d15dbf204b2d service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:58.440480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa2c41-8cef-4b65-9d59-d15dbf204b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:58.441201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa2c41-8cef-4b65-9d59-d15dbf204b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.461432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:58.462171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:58.463049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.469271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa2c41-8cef-4b65-9d59-d15dbf204b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:58.512459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] MFA Rules not processed for user `45a491cd7bb8422fb6e3ee727d7b15f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:58.514137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:58.523512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa2c41-8cef-4b65-9d59-d15dbf204b2d service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:58.535024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 794/1591] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:58 2022] GET /identity/v3/auth/tokens => generated 3779 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:46:58.693448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 798/1592] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:58.702358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:58.703495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:58.704244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.761573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:58.788027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] MFA Rules not processed for user `45a491cd7bb8422fb6e3ee727d7b15f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:58.789370 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:58.816301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 795/1593] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:58 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:46:58.821095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:58.961185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e726e-8a19-481c-841e-c15a47a94b82 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:58.972996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:58.973861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:58.974157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:58.974442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] PATH_INFO: `/v3/users/dad616a8c2c842f8bafc32c30a719a5e` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:58.976375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad616a8c2c842f8bafc32c30a719a5e)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:58.991609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00433b-7a0a-426c-a9d8-490ae721633b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:59.002925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:59.003531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.003821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.004099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.020894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:59.037712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: WARNING py.warnings [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:46:59.037712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: warnings.warn(msg) Feb 28 18:46:59.037712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: Feb 28 18:46:59.040008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:59.065510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:59.085608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 796/1594] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:58 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:59.087371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:59.099026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bf090-fb47-4b53-9f29-a5fc3b7a3f00 service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:59.103837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:59.105152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.105648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.106120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] PATH_INFO: `/v3/users/00e2342ffaa347ea9948d3b0ed19feef` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.108694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e2342ffaa347ea9948d3b0ed19feef)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:59.153602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:59.169518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad616a8c2c842f8bafc32c30a719a5e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.183530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad616a8c2c842f8bafc32c30a719a5e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.200219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad616a8c2c842f8bafc32c30a719a5e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.200959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad616a8c2c842f8bafc32c30a719a5e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.201621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad616a8c2c842f8bafc32c30a719a5e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.243886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e2342ffaa347ea9948d3b0ed19feef'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.244705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 799/1595] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:46:58 2022] DELETE /identity/v3/users/dad616a8c2c842f8bafc32c30a719a5e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:59.245850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:59.248368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:59.267923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e2342ffaa347ea9948d3b0ed19feef'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.268522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e2342ffaa347ea9948d3b0ed19feef'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.289491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e2342ffaa347ea9948d3b0ed19feef'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.303125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0dae0737-2afe-4e15-a132-3c856b3a098a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e2342ffaa347ea9948d3b0ed19feef'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:46:59.315562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 797/1596] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:46:59 2022] DELETE /identity/v3/users/00e2342ffaa347ea9948d3b0ed19feef => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:46:59.315562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f46c1-f7c2-4465-a216-1642a233fb59 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.315562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f46c1-f7c2-4465-a216-1642a233fb59 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.315562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f46c1-f7c2-4465-a216-1642a233fb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.364889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-917f46c1-f7c2-4465-a216-1642a233fb59 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:59.366087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-917f46c1-f7c2-4465-a216-1642a233fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:59.437948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04626-3228-43ed-b9c2-9ac12697b495 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:59.480069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 798/1597] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:59.481498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.481791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.482071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.509075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:46:59.510395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:59.520365 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 799/1598] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:46:59.611671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:59.613107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:59.624025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:59.624634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.624922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.625204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.635856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:46:59.704094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509416e-0b99-4ec3-8bd1-9f47639ff076 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:59.713654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc927726-ccbf-4635-be11-73a5670696d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:59.715344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc927726-ccbf-4635-be11-73a5670696d8 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.715547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc927726-ccbf-4635-be11-73a5670696d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.716857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc927726-ccbf-4635-be11-73a5670696d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.740491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc927726-ccbf-4635-be11-73a5670696d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:59.797384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc927726-ccbf-4635-be11-73a5670696d8 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:59.805994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:46:59.814753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 800/1599] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:59.849241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:46:59.867360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 800/1600] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:59 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:46:59.887227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19ffb-0a0a-43a0-85ed-28fa1905964b None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.887553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19ffb-0a0a-43a0-85ed-28fa1905964b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.887831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19ffb-0a0a-43a0-85ed-28fa1905964b None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.889491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 801/1601] 10.222.0.18 () {54 vars in 912 bytes} [Mon Feb 28 18:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:46:59.890525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:46:59.900533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d37b61-79d9-4de3-a39c-69ebfdba395d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.900819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d37b61-79d9-4de3-a39c-69ebfdba395d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.901096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d37b61-79d9-4de3-a39c-69ebfdba395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.911365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6246fd-837b-4505-b26c-94b0b50ec79a service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:46:59.923463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:46:59.924889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:46:59.925176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:46:59.925456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:46:59.948185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:00.038936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:00.050234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-10d37b61-79d9-4de3-a39c-69ebfdba395d None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:00.051410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-10d37b61-79d9-4de3-a39c-69ebfdba395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:00.052956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 801/1602] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:46:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:00.059452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 802/1603] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Feb 28 18:46:59 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:00.092598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:00.093985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:00.106022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d78-df31-4301-90ea-f5551c2c2842 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:00.110692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910eac5-d252-4c6e-a2cf-34e6c415b2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:00.111155 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910eac5-d252-4c6e-a2cf-34e6c415b2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:00.111349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910eac5-d252-4c6e-a2cf-34e6c415b2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:00.111679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910eac5-d252-4c6e-a2cf-34e6c415b2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:00.119723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910eac5-d252-4c6e-a2cf-34e6c415b2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:00.147020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910eac5-d252-4c6e-a2cf-34e6c415b2b5 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:00.156404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 802/1604] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:00 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:00.930852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ceb24-e86d-4467-84d5-ec789e4e3b2a None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:00.931424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ceb24-e86d-4467-84d5-ec789e4e3b2a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:00.931424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ceb24-e86d-4467-84d5-ec789e4e3b2a None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:00.934255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 803/1605] 10.222.0.18 () {54 vars in 960 bytes} [Mon Feb 28 18:47:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:00.944704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c8924-ab79-4ecf-ba27-adec295d72cd None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:00.945249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c8924-ab79-4ecf-ba27-adec295d72cd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:00.945426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c8924-ab79-4ecf-ba27-adec295d72cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:00.990850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-984c8924-ab79-4ecf-ba27-adec295d72cd None None] MFA Rules not processed for user `428c5ed13bcf410490fbac7a992a86ed`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:00.996205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-984c8924-ab79-4ecf-ba27-adec295d72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:01.158056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 803/1606] 10.222.0.18 () {58 vars in 1057 bytes} [Mon Feb 28 18:47:00 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:01.182276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ceb24-e86d-4467-84d5-ec789e4e3b2a None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:01.210498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ceb24-e86d-4467-84d5-ec789e4e3b2a None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:01.227775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:01.228585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:01.229487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:01.230118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:01.232070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:01.260779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:01.337712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ef44d-697e-4fcb-87f7-ae10cddacc54 service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:01.362540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 804/1607] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:01 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:01.466591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95209fd3-cc4d-4824-90fe-d9aa28517fc5 None None] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:01.467054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95209fd3-cc4d-4824-90fe-d9aa28517fc5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:01.467413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95209fd3-cc4d-4824-90fe-d9aa28517fc5 None None] PATH_INFO: `/` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:01.469845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 804/1608] 10.222.0.18 () {54 vars in 912 bytes} [Mon Feb 28 18:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:01.482292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:01.483329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:01.484249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:01.556483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95209fd3-cc4d-4824-90fe-d9aa28517fc5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:01.558787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-95209fd3-cc4d-4824-90fe-d9aa28517fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:01.567330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:01.573454 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:01.583949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95209fd3-cc4d-4824-90fe-d9aa28517fc5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:01.591881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 805/1609] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Feb 28 18:47:01 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:01.595248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:01.597781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:01.597781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:01.603411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] PATH_INFO: `/v3/projects/726c24ca1e8e4efc951e601606096221` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:01.607835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] RBAC: Authorizing `identity:delete_project(project_id=726c24ca1e8e4efc951e601606096221)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:01.619527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:01.632966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2bb69-6fb5-4db3-921d-d4ab4cdf5a0b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:01.639337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:01.640125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:01.640272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:01.640496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:01.658616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:01.714509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:01.714702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:01.742732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 806/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:01 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:01.744009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:01.753133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:01.785257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fff2b-b847-4bbc-8503-d18e23ff609b service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:01.790906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:01.791729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:01.792018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:01.792302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] PATH_INFO: `/v3/projects/fa753859778c44c5bf4fe483dc278775` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:01.793416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa753859778c44c5bf4fe483dc278775)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:01.843128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726c24ca1e8e4efc951e601606096221', 'request_id': 'req-41901a4c-c3a7-46cd-80d3-0db5fd58159e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.847626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: WARNING py.warnings [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:47:01.847626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: warnings.warn(msg) Feb 28 18:47:01.847626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: Feb 28 18:47:01.853878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:01.855959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726c24ca1e8e4efc951e601606096221', 'request_id': 'req-41901a4c-c3a7-46cd-80d3-0db5fd58159e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.870674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726c24ca1e8e4efc951e601606096221', 'request_id': 'req-41901a4c-c3a7-46cd-80d3-0db5fd58159e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.918097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] The token cache is being invalidate because project 726c24ca1e8e4efc951e601606096221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:01.918576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.919268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.921519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 805/1611] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:01 2022] DELETE /identity/v3/projects/726c24ca1e8e4efc951e601606096221 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:01.922205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:01.923640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:01.957550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa753859778c44c5bf4fe483dc278775', 'request_id': 'req-61c4fd61-8179-4c42-8242-5b106ff25d22'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.964463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa753859778c44c5bf4fe483dc278775', 'request_id': 'req-61c4fd61-8179-4c42-8242-5b106ff25d22'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:01.975241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa753859778c44c5bf4fe483dc278775', 'request_id': 'req-61c4fd61-8179-4c42-8242-5b106ff25d22'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.020299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] The token cache is being invalidate because project fa753859778c44c5bf4fe483dc278775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:02.021985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.023846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.027316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 807/1612] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:01 2022] DELETE /identity/v3/projects/fa753859778c44c5bf4fe483dc278775 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:02.033718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:02.039365 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:02.046063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41901a4c-c3a7-46cd-80d3-0db5fd58159e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:02.152689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:02.153538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4fd61-8179-4c42-8242-5b106ff25d22 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:02.154152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:02.154765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:02.155360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:02.157508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:02.162970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:02.164263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:02.164789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:02.165285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] PATH_INFO: `/v3/users/cb3721a9cd9c4d0f961fe660f8b80730` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:02.167700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3721a9cd9c4d0f961fe660f8b80730)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:02.176314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:02.197071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:02.223630 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab466519-407c-4f43-9ea3-cb4f016845a7 service placement] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:02.241767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 806/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:01 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:02.243587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187db71-00a5-4b96-9915-1a8172bb4f66 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:02.243587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187db71-00a5-4b96-9915-1a8172bb4f66 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:02.243587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187db71-00a5-4b96-9915-1a8172bb4f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:02.279441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a187db71-00a5-4b96-9915-1a8172bb4f66 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:02.280753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a187db71-00a5-4b96-9915-1a8172bb4f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:02.297368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3721a9cd9c4d0f961fe660f8b80730'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.306350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 807/1614] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:02.308597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:02.308896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:02.309548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:02.318282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3721a9cd9c4d0f961fe660f8b80730'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.319099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3721a9cd9c4d0f961fe660f8b80730'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.360792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3721a9cd9c4d0f961fe660f8b80730'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.379754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3721a9cd9c4d0f961fe660f8b80730'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:02.399657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 808/1615] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:02 2022] DELETE /identity/v3/users/cb3721a9cd9c4d0f961fe660f8b80730 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:02.411635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:02.415148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:02.559654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 808/1616] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:02.563959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:02.576701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fefd8-b79d-4901-aedf-d7acf583d3c5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:02.584851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:02.585540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:02.594429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:02.594429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:02.595013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:02.595384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:02.649039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:02.698030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 809/1617] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:02.702382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:02.714105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a927f5-fb53-4dce-98ff-50b6b50f7f8b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:02.719662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:02.720326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:02.721208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:02.721208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:02.722356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:02.768196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:02.838961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 809/1618] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:02 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:02.843258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:02.855801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f472-c8bd-4855-9031-8d2deae03250 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:02.998965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:03.000513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:03.001065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:03.001564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:03.003056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:03.012832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:03.014834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:03.042983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c192d4-7139-4106-9a1c-ef6b5925bedf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:03.048890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:03.067339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:03.068178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:03.068470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:03.068743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] PATH_INFO: `/v3/users/7ab0c4b4cdb94138bb8bdfeb77cdbff8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:03.076213 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab0c4b4cdb94138bb8bdfeb77cdbff8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:03.106239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 810/1619] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:02 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:03.110256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:03.138038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50720f76-e827-4290-b633-c02511bdc785 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:03.147005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:03.150857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:03.151480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:03.155912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:03.156907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:03.160045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:03.326352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab0c4b4cdb94138bb8bdfeb77cdbff8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:03.333302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:03.345124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab0c4b4cdb94138bb8bdfeb77cdbff8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:03.369157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 811/1620] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:03.372820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:03.384572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab0c4b4cdb94138bb8bdfeb77cdbff8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:03.385322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab0c4b4cdb94138bb8bdfeb77cdbff8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:03.386047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9d4cdbef-d738-44a2-9c5f-b76ca481afd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab0c4b4cdb94138bb8bdfeb77cdbff8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:03.402903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bddf9-9861-4dab-96f4-61baf6ed6850 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:03.416169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6361-e2ea-4fb6-aa07-faf8cbe84082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:03.417015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6361-e2ea-4fb6-aa07-faf8cbe84082 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:03.417303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6361-e2ea-4fb6-aa07-faf8cbe84082 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:03.420345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6361-e2ea-4fb6-aa07-faf8cbe84082 admin admin] PATH_INFO: `/v3/projects/d6d6723d077b40fa8ca5e17b3d3ff8c5/users/5b09fcc85aa44645862750df41287d40/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:03.426886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 810/1621] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:03 2022] DELETE /identity/v3/users/7ab0c4b4cdb94138bb8bdfeb77cdbff8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:03.428673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:03.429051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:03.429436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:03.466262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace6361-e2ea-4fb6-aa07-faf8cbe84082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d6723d077b40fa8ca5e17b3d3ff8c5, user_id=5b09fcc85aa44645862750df41287d40, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:03.503314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:03.505463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:03.517224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace6361-e2ea-4fb6-aa07-faf8cbe84082 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:03.559550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 812/1622] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:03 2022] PUT /identity/v3/projects/d6d6723d077b40fa8ca5e17b3d3ff8c5/users/5b09fcc85aa44645862750df41287d40/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:03.570736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:03.571030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:03.571312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:03.682419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] MFA Rules not processed for user `5b09fcc85aa44645862750df41287d40`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:03.683912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:03.691221 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 811/1623] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:03.808896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:03.810471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:03.852320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 813/1624] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:03 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:03.853380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:03.865525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:03.991457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f207-a803-4495-814c-764bbf0ac412 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:04.082740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:04.083332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.083626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.083915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.092344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed8d42-db1f-44c1-a13a-7e7c3b7cbe01 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:04.105997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:04.106579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.106863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.107146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.107841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:04.110000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:04.207285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:04.219525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:04.271445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 812/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:04.350584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 814/1626] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:03 2022] POST /identity/v3/projects => generated 381 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:04.354393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:04.373426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9908c-5c7b-4c37-bf67-91f71cf9c04a service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:04.619020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:04.619578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.619860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.620149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.621183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:04.698715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:04.790304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 813/1627] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:04 2022] POST /identity/v3/users => generated 297 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:04.793909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:04.804464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53a400-a8bb-4812-8a6b-8ff2efde0327 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:04.821762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:04.822760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.823024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.831822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.832609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:04.882191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:04.902409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 815/1628] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:04.907259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:04.923941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4058d3-b021-4468-a233-71a6365e8d8a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:04.942032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74564b-0fd6-421d-b5f6-6ef8da8de208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:04.943529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74564b-0fd6-421d-b5f6-6ef8da8de208 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:04.944232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74564b-0fd6-421d-b5f6-6ef8da8de208 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:04.944232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74564b-0fd6-421d-b5f6-6ef8da8de208 admin admin] PATH_INFO: `/v3/projects/5ecc111b7f384d68bb7329996721683c/users/c929298d2024450eb9334d97fb85e1ba/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:04.991880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74564b-0fd6-421d-b5f6-6ef8da8de208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecc111b7f384d68bb7329996721683c, user_id=c929298d2024450eb9334d97fb85e1ba, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:05.049342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74564b-0fd6-421d-b5f6-6ef8da8de208 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.079430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 814/1629] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:04 2022] PUT /identity/v3/projects/5ecc111b7f384d68bb7329996721683c/users/c929298d2024450eb9334d97fb85e1ba/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:05.084220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:05.095248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aa573-8c72-41d5-8d86-1e1a7821dba3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:05.266718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:05.269737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.271471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.273548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.274441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:05.360682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.378875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.379266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.379542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.388195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 816/1630] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:05.396387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:05.417005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e18ab8-4987-4e75-b8fd-8ba449770da8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:05.418167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:05.419760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:05.431982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:05.433727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.434026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.434307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] PATH_INFO: `/v3/projects/5ecc111b7f384d68bb7329996721683c/users/c929298d2024450eb9334d97fb85e1ba/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.441320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecc111b7f384d68bb7329996721683c, user_id=c929298d2024450eb9334d97fb85e1ba, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:05.501157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.526513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 817/1631] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:05 2022] PUT /identity/v3/projects/5ecc111b7f384d68bb7329996721683c/users/c929298d2024450eb9334d97fb85e1ba/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:05.530306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:05.567639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 815/1632] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:47:05 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:05.706436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1b147-5268-45bf-a8fe-b0b4ad87912d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:05.716257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:05.716899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.717187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.717470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.718194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:05.764519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.792767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 818/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:05.796901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:05.817092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de78c84-95a2-4849-af8c-669a44d9a808 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:05.827689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678919e-2881-4311-a02a-bbd0930fcd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:05.829482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678919e-2881-4311-a02a-bbd0930fcd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.829810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678919e-2881-4311-a02a-bbd0930fcd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.830243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678919e-2881-4311-a02a-bbd0930fcd1f admin admin] PATH_INFO: `/v3/projects/5ecc111b7f384d68bb7329996721683c/users/c929298d2024450eb9334d97fb85e1ba/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:05.833476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678919e-2881-4311-a02a-bbd0930fcd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecc111b7f384d68bb7329996721683c, user_id=c929298d2024450eb9334d97fb85e1ba, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:05.857193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:05.859418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:05.898906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678919e-2881-4311-a02a-bbd0930fcd1f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:05.954439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 816/1634] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:05 2022] PUT /identity/v3/projects/5ecc111b7f384d68bb7329996721683c/users/c929298d2024450eb9334d97fb85e1ba/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:05.964963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:05.965580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:05.966037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:06.082132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d28d-6269-40a4-881f-db17fd416088 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:06.107560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] MFA Rules not processed for user `c929298d2024450eb9334d97fb85e1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:06.108745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:06.280374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79559203-988b-4056-adac-af72d1465018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:06.281126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559203-988b-4056-adac-af72d1465018 service swift] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:06.281276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559203-988b-4056-adac-af72d1465018 service swift] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:06.283298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559203-988b-4056-adac-af72d1465018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:06.285841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 817/1635] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:05 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:06.297053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:06.299641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:06.462924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559203-988b-4056-adac-af72d1465018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:06.492371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559203-988b-4056-adac-af72d1465018 service swift] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:06.529959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f192-2102-460d-a8b1-ba6cbe2b14ad None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:06.545875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 819/1636] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:47:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 18:47:06.561317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:06.562136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:06.562595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:06.563018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:06.607467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79559203-988b-4056-adac-af72d1465018 service swift] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:06.609025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-79559203-988b-4056-adac-af72d1465018 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:06.613452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:06.716007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:06.745257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 818/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:06 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:06.919767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79559203-988b-4056-adac-af72d1465018 service swift] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:06.933258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:06.934429 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:06.934982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:06.936851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] PATH_INFO: `/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:06.939595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff9019ac4984c1bbc15f1b5308e0340)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:06.968540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.042510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff9019ac4984c1bbc15f1b5308e0340', 'request_id': 'req-bbbecf9a-239c-4c93-804d-5e21af08c4dc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:07.052404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff9019ac4984c1bbc15f1b5308e0340', 'request_id': 'req-bbbecf9a-239c-4c93-804d-5e21af08c4dc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:07.075618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff9019ac4984c1bbc15f1b5308e0340', 'request_id': 'req-bbbecf9a-239c-4c93-804d-5e21af08c4dc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:07.077989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.091658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35b86e-1c43-4c48-ae72-057896ca0845 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.122361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] The token cache is being invalidate because project 5ff9019ac4984c1bbc15f1b5308e0340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:07.123068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:07.126124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-bbbecf9a-239c-4c93-804d-5e21af08c4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:07.130368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 820/1638] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:06 2022] DELETE /identity/v3/projects/5ff9019ac4984c1bbc15f1b5308e0340 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:07.135594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff5ec-ec06-4678-b355-629dcc85a16b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.136297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff5ec-ec06-4678-b355-629dcc85a16b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.136819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff5ec-ec06-4678-b355-629dcc85a16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.211564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-91cff5ec-ec06-4678-b355-629dcc85a16b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:07.213663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-91cff5ec-ec06-4678-b355-629dcc85a16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:07.277212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.278324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.279023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.279695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.288289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:07.479299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 821/1639] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:07.487317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.487805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.488345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.568632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:07.570278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:07.571967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:07.602894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 822/1640] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:07.604453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.622948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d0489-ff2d-42a2-8d94-15c2393105e3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.641736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.642388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.642716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.643178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.643699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.644023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:07.644322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:07.664420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 819/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:07.708680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.742242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 823/1642] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:07.746923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.760539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22589509-d59a-4a7c-9d2b-061179ebcf8c service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:07.773134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:07.773754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:07.774206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:07.774496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:07.775188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:07.830231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:07.891762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:07.892224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 820/1643] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:07 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:07.907002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a364b-9443-4a89-917f-51f1852bcb0b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:08.048806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:08.051588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:08.052014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:08.055027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:08.055975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:08.137428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:08.217510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 824/1644] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:07 2022] POST /identity/v3/users => generated 284 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:08.221954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:08.233060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8ebd8-e504-4cb3-83b3-e6b585733520 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:08.265208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca68e96-cd04-4e9d-8ac8-420a9637a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:08.266030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68e96-cd04-4e9d-8ac8-420a9637a2ea admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:08.266331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68e96-cd04-4e9d-8ac8-420a9637a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:08.266708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68e96-cd04-4e9d-8ac8-420a9637a2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:08.273477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca68e96-cd04-4e9d-8ac8-420a9637a2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:08.382160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca68e96-cd04-4e9d-8ac8-420a9637a2ea admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:08.413849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 821/1645] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:08.415549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:08.440196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fda1bb-91e0-4c61-9b92-3828e9096d1f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:08.467717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:08.468576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:08.468860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:08.469172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] PATH_INFO: `/v3/projects/94489c45c6e54293b3372569788bd76d/users/42590e9644c24491986adf90bf34528a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:08.525843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94489c45c6e54293b3372569788bd76d, user_id=42590e9644c24491986adf90bf34528a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:08.596216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:08.653029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 825/1646] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:08 2022] PUT /identity/v3/projects/94489c45c6e54293b3372569788bd76d/users/42590e9644c24491986adf90bf34528a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:08.655553 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:08.656061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:08.656497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:08.799225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] MFA Rules not processed for user `42590e9644c24491986adf90bf34528a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:08.804672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:09.005473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 822/1647] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:08 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:09.006831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:09.164972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:09.172956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:09.232918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ee091-ffd3-4367-bd02-9140c0be6a50 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:09.247112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:09.248130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:09.248577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:09.248868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:09.249522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:09.311155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:09.397316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 826/1648] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:09 2022] POST /identity/v3/projects => generated 369 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:09.401310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:09.457949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588477d-9f65-4187-a074-9485fdf812f1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:09.658863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41f1e6-aa3e-49f1-ba43-150a5a9f2306 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:09.660676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:09.661938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:09.662394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:09.662891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] PATH_INFO: `/v3/projects/892e009800754f2e804106e693211cf4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:09.664464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=892e009800754f2e804106e693211cf4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:09.678071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:09.679044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:09.679511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:09.679903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:09.680849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:09.696958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:09.730941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:09.765901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 827/1649] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:09 2022] POST /identity/v3/users => generated 291 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:09.769965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:09.811036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892e009800754f2e804106e693211cf4', 'request_id': 'req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:09.811705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848695dd-5ab2-45c9-94cf-e2dc5674bac6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:09.836824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892e009800754f2e804106e693211cf4', 'request_id': 'req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:09.860038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892e009800754f2e804106e693211cf4', 'request_id': 'req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:09.922730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] The token cache is being invalidate because project 892e009800754f2e804106e693211cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:09.924596 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:09.925435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-58cf5108-7fb7-4a8a-9b60-1ac6b0b3bf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:09.931042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 823/1650] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:09 2022] DELETE /identity/v3/projects/892e009800754f2e804106e693211cf4 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:09.938336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5aa8b-f912-41e7-a297-d098f3ffe087 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:09.938659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5aa8b-f912-41e7-a297-d098f3ffe087 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:09.943562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5aa8b-f912-41e7-a297-d098f3ffe087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.007115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-46a5aa8b-f912-41e7-a297-d098f3ffe087 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:10.008356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-46a5aa8b-f912-41e7-a297-d098f3ffe087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:10.034925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.036098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.036688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.037265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.038355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:10.084936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.099193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 828/1651] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:10.106047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.106467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:10.121781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3bb93-61d1-4d88-aa6f-f64cc651ef63 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.129816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.143579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.144037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.146370 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] PATH_INFO: `/v3/projects/da302e77d42248a8b9826c26653a4ea0/users/5e71e20419c746d58ad2631ce68a867b/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.220991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da302e77d42248a8b9826c26653a4ea0, user_id=5e71e20419c746d58ad2631ce68a867b, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:10.222371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 824/1652] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:10.231816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0097-d299-4c31-80a7-da19d284ca6b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.232060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0097-d299-4c31-80a7-da19d284ca6b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.232232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0097-d299-4c31-80a7-da19d284ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.302944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9d6d0097-d299-4c31-80a7-da19d284ca6b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:10.304443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9d6d0097-d299-4c31-80a7-da19d284ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:10.324751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 825/1653] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:10.325823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.326122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.326406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.345321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.419958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 829/1654] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:10 2022] PUT /identity/v3/projects/da302e77d42248a8b9826c26653a4ea0/users/5e71e20419c746d58ad2631ce68a867b/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:10.435520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.451038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] MFA Rules not processed for user `6b707673c1614cb59683ffa0810cc6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:10.452244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:10.745288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6ecd-d151-4e00-ad60-c6830f0e2a3a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.749030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 826/1655] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:10 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:10.750464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.763643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.764749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.765485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.766032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.767943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:10.768942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:10.770333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc2810-02fe-4c97-bb75-f45544d3e33b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.805171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.808105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.808577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.810581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.816957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:10.839112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.880339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 830/1656] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:10.885336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.889439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:10.891485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:10.918731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 827/1657] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:10.920689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:10.967735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4baf-c917-45d7-b8ec-8cff6c51d245 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:10.983164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:10.987290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:10.988659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:10.989835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:10.993833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:11.091078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:11.147186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 828/1658] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:10 2022] POST /identity/v3/projects => generated 409 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:11.148424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:11.168416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4559f8-14a3-4230-b270-8f203dd59723 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:11.298264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:11.299281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:11.299685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:11.300119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:11.361787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41f41d-250b-4a25-87b7-300dadc1ee89 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:11.370771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:11.371808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:11.372167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:11.372520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] PATH_INFO: `/v3/projects/da302e77d42248a8b9826c26653a4ea0/users/5e71e20419c746d58ad2631ce68a867b/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:11.380506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da302e77d42248a8b9826c26653a4ea0, user_id=5e71e20419c746d58ad2631ce68a867b, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:11.414207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:11.439731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:11.449572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:11.467287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 829/1659] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:11 2022] PUT /identity/v3/projects/da302e77d42248a8b9826c26653a4ea0/users/5e71e20419c746d58ad2631ce68a867b/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:11.468242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:11.488888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 831/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:10 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:11.491055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:11.519945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed9a28-bb92-44e2-a2f9-3d804bb6ef82 service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:11.648338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc8f49-18b6-44bd-871d-4724779e2969 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:11.668149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:11.669206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:11.669620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:11.670043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:11.671123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:11.679455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:11.681445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:11.682004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:11.683507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:11.684613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:11.710730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:11.727330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 832/1661] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:11.733382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:11.751125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c292b8-fbc2-43dc-9a5b-a9d16764cd9b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:11.762481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff8cdd-9c48-446f-8940-a199e2def11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:11.765192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff8cdd-9c48-446f-8940-a199e2def11a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:11.765989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff8cdd-9c48-446f-8940-a199e2def11a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:11.766730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff8cdd-9c48-446f-8940-a199e2def11a admin admin] PATH_INFO: `/v3/projects/da302e77d42248a8b9826c26653a4ea0/users/5e71e20419c746d58ad2631ce68a867b/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:11.771899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff8cdd-9c48-446f-8940-a199e2def11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da302e77d42248a8b9826c26653a4ea0, user_id=5e71e20419c746d58ad2631ce68a867b, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:11.828955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff8cdd-9c48-446f-8940-a199e2def11a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:11.861248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:11.873690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 833/1662] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:11 2022] PUT /identity/v3/projects/da302e77d42248a8b9826c26653a4ea0/users/5e71e20419c746d58ad2631ce68a867b/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:11.875467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671283-1859-4dab-939c-ec798944fa21 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:11.875857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671283-1859-4dab-939c-ec798944fa21 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:11.876314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671283-1859-4dab-939c-ec798944fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:11.936661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c2671283-1859-4dab-939c-ec798944fa21 None None] MFA Rules not processed for user `5e71e20419c746d58ad2631ce68a867b`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:11.938609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c2671283-1859-4dab-939c-ec798944fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:11.960728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 830/1663] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:11 2022] POST /identity/v3/users => generated 305 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:11.960728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.017373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874209-9f72-4473-b2aa-7324d8c55bcf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.059462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 834/1664] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:11 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:12.065866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.066401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.066825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.099867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:12.101751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:12.281594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 835/1665] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Feb 28 18:47:12 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:12.296323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.300287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:12.366065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.366706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.367706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.367706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.367968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:12.474448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:12.535506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 831/1666] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:12.536560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.540875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:12.581645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47f6b2-48ce-4c3f-b619-1833086b2c8e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.581883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf9fe-c3d3-42fb-9bd8-677c4db858b2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.598111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.602395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.603795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.604165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.605899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.612206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.612518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.614047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.638486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:12.641218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:12.687578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:12.712299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:12.737375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 836/1667] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:12.738193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.761424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 832/1668] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:12.813449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570cc52-6223-4cd0-8388-4ca34e02d38f service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:12.849294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbbe7-565f-4d05-bfc0-139449b39c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:12.849294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbbe7-565f-4d05-bfc0-139449b39c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:12.849712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbbe7-565f-4d05-bfc0-139449b39c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:12.850224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbbe7-565f-4d05-bfc0-139449b39c6f admin admin] PATH_INFO: `/v3/projects/1ff964b0060e457593a5cb57f46fdbec/users/924c7dc9706f40d68950b634bf64a59a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:12.942329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbbe7-565f-4d05-bfc0-139449b39c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff964b0060e457593a5cb57f46fdbec, user_id=924c7dc9706f40d68950b634bf64a59a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:12.963161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:12.982789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a976-986c-4281-95ca-87964e50dbc1 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.004934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.005555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.012492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.013098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.017709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbbe7-565f-4d05-bfc0-139449b39c6f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.018112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:13.057939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 837/1669] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:12 2022] PUT /identity/v3/projects/1ff964b0060e457593a5cb57f46fdbec/users/924c7dc9706f40d68950b634bf64a59a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:13.059794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.060233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.060619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.179514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] MFA Rules not processed for user `924c7dc9706f40d68950b634bf64a59a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:13.184720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:13.256180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:13.325121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.349616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 833/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:12 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:13.425316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 838/1671] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:13 2022] POST /identity/v3/auth/tokens => generated 3716 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:13.426198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.439822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9e2f4-c15d-40b6-84cb-e95e4d8dbdf0 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.616431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.617203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.618743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.619034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.619689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:13.679639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:13.737290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 834/1672] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:13 2022] POST /identity/v3/projects => generated 407 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:13.739123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:13.756355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0271d-7553-4d17-b525-3236e082aa05 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:13.935014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:13.936601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:13.937119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:13.937618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:13.938677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:14.029502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:14.071509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 839/1673] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:13 2022] POST /identity/v3/users => generated 310 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:14.071731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:14.089878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d49e23-744c-428b-baed-6e44429e3365 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:14.094371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:14.095006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:14.095325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:14.095691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:14.097046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:14.148426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:14.177200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 835/1674] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:14.178732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:14.206148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db79d42-6bf2-41c3-856c-73837665079a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:14.218765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:14.220412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:14.222090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:14.223280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] PATH_INFO: `/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d/users/d7ad654a24a84b72814984c15388564c/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:14.299733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf72ac52de2c41acb1f8fb0bfd91dd0d, user_id=d7ad654a24a84b72814984c15388564c, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:14.460655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:14.498712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 840/1675] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:14 2022] PUT /identity/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d/users/d7ad654a24a84b72814984c15388564c/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:14.503485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:14.518522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f577e3-4524-4356-a41a-14a0fe5e12a1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:14.694329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:14.695365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:14.695894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:14.696520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:14.698482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:14.729336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:14.743558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 836/1676] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:14.747522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:14.762114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a5a47-f10b-47af-a0a6-325fdab6cbd3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:14.768428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:14.769582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:14.770054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:14.770514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] PATH_INFO: `/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d/users/d7ad654a24a84b72814984c15388564c/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:14.773090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf72ac52de2c41acb1f8fb0bfd91dd0d, user_id=d7ad654a24a84b72814984c15388564c, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:14.815798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:14.827679 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 841/1677] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:14 2022] PUT /identity/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d/users/d7ad654a24a84b72814984c15388564c/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:14.832377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:14.844237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d534d-66fb-47ef-8f0c-76ef21117092 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:14.940809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a231103-476d-44c2-aab9-75bd96dbae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:14.941723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231103-476d-44c2-aab9-75bd96dbae62 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:14.942180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231103-476d-44c2-aab9-75bd96dbae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:14.942748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a231103-476d-44c2-aab9-75bd96dbae62 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:14.943828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231103-476d-44c2-aab9-75bd96dbae62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:14.974504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a231103-476d-44c2-aab9-75bd96dbae62 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:14.990413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 837/1678] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:14.995256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.008130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174c0b4-8894-4e7d-a9e8-abd5c8933dee admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.016759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.018934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.020236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.020715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] PATH_INFO: `/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d/users/d7ad654a24a84b72814984c15388564c/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.024262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf72ac52de2c41acb1f8fb0bfd91dd0d, user_id=d7ad654a24a84b72814984c15388564c, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:15.084328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.114695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 842/1679] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:14 2022] PUT /identity/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d/users/d7ad654a24a84b72814984c15388564c/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:15.130635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.130635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.130635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.268147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] MFA Rules not processed for user `d7ad654a24a84b72814984c15388564c`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:15.271821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:15.561151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 838/1680] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:15 2022] POST /identity/v3/auth/tokens => generated 3781 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:15.573090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:15.574807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:15.725284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a96a2-68ee-46e3-9253-476337f98231 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:15.731029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc2cf-d5d7-4d0a-90ec-186736c5c29c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:15.731890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc2cf-d5d7-4d0a-90ec-186736c5c29c service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:15.732015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc2cf-d5d7-4d0a-90ec-186736c5c29c service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:15.732281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc2cf-d5d7-4d0a-90ec-186736c5c29c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:15.757013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc2cf-d5d7-4d0a-90ec-186736c5c29c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:15.809173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc2cf-d5d7-4d0a-90ec-186736c5c29c service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:15.836634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 843/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:15 2022] GET /identity/v3/auth/tokens => generated 3781 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:16.725860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:16.740534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e546fe-496a-4957-b104-a36dd4d4c5ea None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:16.752297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51893394-7c71-4e00-897d-5b0799a94c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:16.753185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51893394-7c71-4e00-897d-5b0799a94c0d service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:16.753648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51893394-7c71-4e00-897d-5b0799a94c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:16.754085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51893394-7c71-4e00-897d-5b0799a94c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:16.855095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51893394-7c71-4e00-897d-5b0799a94c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:16.909453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51893394-7c71-4e00-897d-5b0799a94c0d service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:16.923455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 839/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:16 2022] GET /identity/v3/auth/tokens => generated 3716 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:18.858993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac762d-3a19-481f-9c8d-d52453d34c63 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.859893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac762d-3a19-481f-9c8d-d52453d34c63 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.860377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac762d-3a19-481f-9c8d-d52453d34c63 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:18.862778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 844/1683] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:47:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:18.961098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:18.961519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:18.961609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:19.013432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:19.014660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:19.168637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 840/1684] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:47:18 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:19.279417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac762d-3a19-481f-9c8d-d52453d34c63 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:19.281346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cbac762d-3a19-481f-9c8d-d52453d34c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:19.328631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac762d-3a19-481f-9c8d-d52453d34c63 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:19.354428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35cd62-c62c-4d20-8d29-e6bb6176bc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:19.358785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cd62-c62c-4d20-8d29-e6bb6176bc4f service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:19.358785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cd62-c62c-4d20-8d29-e6bb6176bc4f service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:19.358785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cd62-c62c-4d20-8d29-e6bb6176bc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:19.377933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35cd62-c62c-4d20-8d29-e6bb6176bc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:19.406935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:19.407318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35cd62-c62c-4d20-8d29-e6bb6176bc4f service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:19.419854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 845/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:19 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:19.568734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56946ac1-f570-40f5-a068-37cfb1c3abff None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:19.575078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:19.576067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:19.576492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:19.577064 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] PATH_INFO: `/v3/users/42590e9644c24491986adf90bf34528a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:19.578331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42590e9644c24491986adf90bf34528a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:19.611097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:19.689484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42590e9644c24491986adf90bf34528a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:19.726379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42590e9644c24491986adf90bf34528a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:19.753267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42590e9644c24491986adf90bf34528a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:19.753940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42590e9644c24491986adf90bf34528a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:19.754640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42590e9644c24491986adf90bf34528a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:19.794342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 841/1686] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:19 2022] DELETE /identity/v3/users/42590e9644c24491986adf90bf34528a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:19.800188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9918575-f859-40ac-997d-b6bff222ad59 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:19.800486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9918575-f859-40ac-997d-b6bff222ad59 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:19.801464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9918575-f859-40ac-997d-b6bff222ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:19.857073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b9918575-f859-40ac-997d-b6bff222ad59 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:19.858886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b9918575-f859-40ac-997d-b6bff222ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:19.995762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 846/1687] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:20.122058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:20.124226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:20.291420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff16da-fe17-47bf-b071-0e36079d0a03 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:20.300196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:20.301210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:20.301629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:20.302071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:20.327538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:20.383586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:20.412065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 842/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:21.476051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.477147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.477671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.521523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] MFA Rules not processed for user `b29711f9ca2e4725b4f702405eb31bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:21.523372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:21.642872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 847/1689] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:21 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:21.656705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:21.658321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:21.814029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feceb4a-6cf6-442d-b452-704876f7a87d service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:21.830514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:21.831475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:21.832685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:21.833206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:21.845733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:21.881616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:21.912824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 843/1690] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:21 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:22.979125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:22.980497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:23.011913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803d83a-6cd6-46b1-abea-5980b33c9914 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:23.016701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:23.017517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.017802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.018111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] PATH_INFO: `/v3/projects/94489c45c6e54293b3372569788bd76d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.019277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94489c45c6e54293b3372569788bd76d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:23.045503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:23.121197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94489c45c6e54293b3372569788bd76d', 'request_id': 'req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.127820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94489c45c6e54293b3372569788bd76d', 'request_id': 'req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.137571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94489c45c6e54293b3372569788bd76d', 'request_id': 'req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.156822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] The token cache is being invalidate because project 94489c45c6e54293b3372569788bd76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:23.157116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.158071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0da0de50-43a4-4eec-8ce1-a2d284b8ad94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.162395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 848/1691] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:22 2022] DELETE /identity/v3/projects/94489c45c6e54293b3372569788bd76d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:23.163589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:23.187165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1b449-ba75-4c57-8fd6-9c297edf4d2c service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:23.279921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:23.280782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.281074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.281360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] PATH_INFO: `/v3/users/5e71e20419c746d58ad2631ce68a867b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.282731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e71e20419c746d58ad2631ce68a867b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:23.310134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:23.386099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e71e20419c746d58ad2631ce68a867b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.396231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e71e20419c746d58ad2631ce68a867b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.405650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e71e20419c746d58ad2631ce68a867b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.418430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e71e20419c746d58ad2631ce68a867b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.419791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f327bf23-ca8e-4a6a-bf86-feecffd84bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e71e20419c746d58ad2631ce68a867b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:23.442799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 844/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:23 2022] DELETE /identity/v3/users/5e71e20419c746d58ad2631ce68a867b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:23.509362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425472f-1bc3-49c3-834e-3a0693dd1f8e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:23.510345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425472f-1bc3-49c3-834e-3a0693dd1f8e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:23.510698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425472f-1bc3-49c3-834e-3a0693dd1f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:23.534897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-4425472f-1bc3-49c3-834e-3a0693dd1f8e None None] MFA Rules not processed for user `6b707673c1614cb59683ffa0810cc6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:23.536904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4425472f-1bc3-49c3-834e-3a0693dd1f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:23.612130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 849/1693] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:23 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:24.065320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.065716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.066106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.104905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] MFA Rules not processed for user `f038a4a281c04d9b9b81caa376c2db71`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:24.106151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.207699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7ad9b-3c0d-4c28-af39-880a07a15f60 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.208945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7ad9b-3c0d-4c28-af39-880a07a15f60 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.209420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7ad9b-3c0d-4c28-af39-880a07a15f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.211482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 845/1694] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:24 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:24.239279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-79a7ad9b-3c0d-4c28-af39-880a07a15f60 None None] MFA Rules not processed for user `f038a4a281c04d9b9b81caa376c2db71`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:24.241735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-79a7ad9b-3c0d-4c28-af39-880a07a15f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.256180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 850/1695] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:24 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:24.263300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:24.264825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.366710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaf296-99ca-4eed-a252-e00ed493926b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:24.372794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:24.373768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.374148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.374528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] PATH_INFO: `/v3/projects/da302e77d42248a8b9826c26653a4ea0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.375751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da302e77d42248a8b9826c26653a4ea0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:24.403947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:24.465374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da302e77d42248a8b9826c26653a4ea0', 'request_id': 'req-05526832-4a40-41a9-bbd8-5caac5abe5f0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:24.471085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da302e77d42248a8b9826c26653a4ea0', 'request_id': 'req-05526832-4a40-41a9-bbd8-5caac5abe5f0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:24.479830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da302e77d42248a8b9826c26653a4ea0', 'request_id': 'req-05526832-4a40-41a9-bbd8-5caac5abe5f0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:24.499594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] The token cache is being invalidate because project da302e77d42248a8b9826c26653a4ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:24.499930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:24.500564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:24.503167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 846/1696] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:24 2022] DELETE /identity/v3/projects/da302e77d42248a8b9826c26653a4ea0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:24.507771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08ff6-94ca-44b9-964d-c5e32a6552a0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.508327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08ff6-94ca-44b9-964d-c5e32a6552a0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.508667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08ff6-94ca-44b9-964d-c5e32a6552a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.531829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6fb08ff6-94ca-44b9-964d-c5e32a6552a0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:24.533994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6fb08ff6-94ca-44b9-964d-c5e32a6552a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.573403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:24.574854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.618907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 851/1697] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:24.626984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.627367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.627708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.651043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:24.652204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.659712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 852/1698] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:24.663162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05526832-4a40-41a9-bbd8-5caac5abe5f0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:24.663801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:24.668463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:24.670182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.670665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.671097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.672750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:24.673021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830540-2fae-4eeb-8a4d-8d30bf06021b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:24.677553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:24.678150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.678441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.678844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.679741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:24.680275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:24.706047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:24.719823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 853/1699] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:24.725426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:24.734684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0370-badb-4e2d-9ce1-fe9ee76f93d1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:24.739364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:24.739934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.740217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.740493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.741246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:24.747069 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:24.770981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:24.772439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:24.783489 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 847/1700] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:24 2022] GET /identity/v3/auth/tokens => generated 3698 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:24.812564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 854/1701] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:24 2022] POST /identity/v3/projects => generated 401 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:24.818176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:24.832368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150359f-c7a8-492f-a0cd-2f3fdf74ae09 service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:24.911286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:24.911835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.912128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.912412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.913103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:24.940015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:24.965058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 848/1702] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:24 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:24.968990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:24.979351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32977045-fb7f-438f-ab28-268ffa7856e0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:24.983458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021cf7f-9687-48d8-8042-c86686ccb54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:24.984058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021cf7f-9687-48d8-8042-c86686ccb54e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:24.984349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021cf7f-9687-48d8-8042-c86686ccb54e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:24.984631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021cf7f-9687-48d8-8042-c86686ccb54e admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:24.985330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021cf7f-9687-48d8-8042-c86686ccb54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:25.012510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021cf7f-9687-48d8-8042-c86686ccb54e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:25.027851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 855/1703] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:25.032202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:25.044754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b85f-f8e2-469b-93cf-7b10ac34a4bd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:25.049960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744c465-5e91-4b65-ab62-b5bac30c3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:25.051763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c465-5e91-4b65-ab62-b5bac30c3f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.052057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c465-5e91-4b65-ab62-b5bac30c3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.052598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c465-5e91-4b65-ab62-b5bac30c3f7c admin admin] PATH_INFO: `/v3/projects/b27f768fedfd4f529a5e2fbb7669cef4/users/d3b2c5a9aeea48ada34ab605b88d6b3d/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.079280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744c465-5e91-4b65-ab62-b5bac30c3f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27f768fedfd4f529a5e2fbb7669cef4, user_id=d3b2c5a9aeea48ada34ab605b88d6b3d, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:25.105013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744c465-5e91-4b65-ab62-b5bac30c3f7c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:25.114190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.115001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.115001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.123599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 849/1704] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:25 2022] PUT /identity/v3/projects/b27f768fedfd4f529a5e2fbb7669cef4/users/d3b2c5a9aeea48ada34ab605b88d6b3d/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:25.135265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.135772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.136170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.141650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] MFA Rules not processed for user `b29711f9ca2e4725b4f702405eb31bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:25.142898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:25.179822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] MFA Rules not processed for user `d3b2c5a9aeea48ada34ab605b88d6b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:25.181067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:25.230695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 856/1705] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:25 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:25.296552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 850/1706] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:25 2022] POST /identity/v3/auth/tokens => generated 3708 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:25.300961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:25.395416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47706f1f-e753-4518-ba48-11de78b14483 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:25.400797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:25.401558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.402072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.402411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.403147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:25.455354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:25.525593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 857/1707] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:25 2022] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:25.530583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:25.544607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3ff9-112b-42a7-af6d-71f628d715bf None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:25.633113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:25.633955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.634199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.634481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.635219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:25.664380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:25.687446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 851/1708] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:25 2022] POST /identity/v3/users => generated 307 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:25.692065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:25.704660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7dd8d-1511-41d4-91e8-59a602e6e9c5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:25.710487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:25.711272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.711673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.712183 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.713552 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:25.742849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:25.762281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 858/1709] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:25.763528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:25.778959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc96ea6-3611-4edd-96af-d98478741fb3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:25.785543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:25.786521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:25.787113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:25.787537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] PATH_INFO: `/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e/users/12f715c8c1cb42f08f7c0ab78f96eea5/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:25.835597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee78ba65fa7841a5bc9c463306d0f38e, user_id=12f715c8c1cb42f08f7c0ab78f96eea5, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:25.865425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:25.883467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 852/1710] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:25 2022] PUT /identity/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e/users/12f715c8c1cb42f08f7c0ab78f96eea5/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:25.887591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:25.900327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522155-6fba-4ec4-ac81-b6757261dbae admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:26.086844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:26.088376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.088812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.089200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.090067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:26.127372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:26.148527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 859/1711] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:26.158782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:26.170635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5bfb5-9fc6-446a-bd70-7f684fe836fa admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:26.180672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:26.183865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.184183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.184623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] PATH_INFO: `/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e/users/12f715c8c1cb42f08f7c0ab78f96eea5/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.190180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee78ba65fa7841a5bc9c463306d0f38e, user_id=12f715c8c1cb42f08f7c0ab78f96eea5, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:26.222322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:26.244407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 853/1712] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:26 2022] PUT /identity/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e/users/12f715c8c1cb42f08f7c0ab78f96eea5/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:26.248438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:26.262238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01858ece-7b82-4225-a579-50c145af1171 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:26.342500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f557-87ae-4aa8-a2e3-0ddaad16696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:26.343339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f557-87ae-4aa8-a2e3-0ddaad16696d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.344029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f557-87ae-4aa8-a2e3-0ddaad16696d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.344504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f557-87ae-4aa8-a2e3-0ddaad16696d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.345448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f557-87ae-4aa8-a2e3-0ddaad16696d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:26.378639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f557-87ae-4aa8-a2e3-0ddaad16696d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:26.393334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 860/1713] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:26.397716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:26.414333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3decaa-e890-49f9-9b75-85db41148f57 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:26.436474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:26.437432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.437948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.438478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] PATH_INFO: `/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e/users/12f715c8c1cb42f08f7c0ab78f96eea5/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.445750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee78ba65fa7841a5bc9c463306d0f38e, user_id=12f715c8c1cb42f08f7c0ab78f96eea5, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:26.489588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:26.516135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 854/1714] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:26 2022] PUT /identity/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e/users/12f715c8c1cb42f08f7c0ab78f96eea5/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:26.527381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:26.528137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:26.528990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:26.663563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] MFA Rules not processed for user `12f715c8c1cb42f08f7c0ab78f96eea5`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:26.667627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:26.828145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 861/1715] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:26 2022] POST /identity/v3/auth/tokens => generated 3775 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:26.838224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:26.839981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:27.042428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef54b9-808d-448c-99f8-35b45f6d0579 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:27.061456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805d645-6e7a-4147-bf05-5ac69a0a4ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:27.061456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805d645-6e7a-4147-bf05-5ac69a0a4ecd service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:27.061777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805d645-6e7a-4147-bf05-5ac69a0a4ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:27.061848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805d645-6e7a-4147-bf05-5ac69a0a4ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:27.095148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805d645-6e7a-4147-bf05-5ac69a0a4ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:27.178776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805d645-6e7a-4147-bf05-5ac69a0a4ecd service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:27.256606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 855/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:26 2022] GET /identity/v3/auth/tokens => generated 3775 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:27.570880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:27.573465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:27.588842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ada1b-0407-40c2-85e7-4d1ca3d95f94 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:27.592118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:27.593100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:27.593489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:27.593868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:27.673324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:27.698134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7047fc-88d3-495f-97ec-8f22ac3e6a1c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:27.698701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7047fc-88d3-495f-97ec-8f22ac3e6a1c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:27.698701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7047fc-88d3-495f-97ec-8f22ac3e6a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:27.712486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:27.736320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-6d7047fc-88d3-495f-97ec-8f22ac3e6a1c None None] MFA Rules not processed for user `f038a4a281c04d9b9b81caa376c2db71`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:27.738922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6d7047fc-88d3-495f-97ec-8f22ac3e6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:27.741108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 862/1717] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:27 2022] GET /identity/v3/auth/tokens => generated 3708 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:27.818679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 856/1718] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:27 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:28.168471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:28.171278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:28.338884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99331057-5444-4212-a606-64a46457f2fb service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:28.349248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:28.350216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.350512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.350820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] PATH_INFO: `/v3/users/5b09fcc85aa44645862750df41287d40` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.352359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b09fcc85aa44645862750df41287d40)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:28.415737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:28.511587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b09fcc85aa44645862750df41287d40'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:28.535651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b09fcc85aa44645862750df41287d40'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:28.536252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b09fcc85aa44645862750df41287d40'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:28.566052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b09fcc85aa44645862750df41287d40'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:28.583628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b09fcc85aa44645862750df41287d40'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:28.602823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 863/1719] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:28 2022] DELETE /identity/v3/users/5b09fcc85aa44645862750df41287d40 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:28.604939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.605248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.605552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:28.654871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:28.656098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:28.744000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 857/1720] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:28.893144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:28.894539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:28.978505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ccd7b-ff37-410f-971b-87012ed1ef43 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:28.982944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007b182-30a6-4226-ba8a-db08d12640e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:28.983942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b182-30a6-4226-ba8a-db08d12640e7 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:28.984299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b182-30a6-4226-ba8a-db08d12640e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:28.984719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007b182-30a6-4226-ba8a-db08d12640e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:29.000255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007b182-30a6-4226-ba8a-db08d12640e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:29.033531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007b182-30a6-4226-ba8a-db08d12640e7 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:29.045512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 864/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:30.561106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:30.565348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:30.583955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1791-a935-412f-83d4-6f5a5b2db685 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:30.593974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:30.595482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.595871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.596234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] PATH_INFO: `/v3/users/924c7dc9706f40d68950b634bf64a59a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.597643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924c7dc9706f40d68950b634bf64a59a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:30.650756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:30.774266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924c7dc9706f40d68950b634bf64a59a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:30.786444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924c7dc9706f40d68950b634bf64a59a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:30.798049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924c7dc9706f40d68950b634bf64a59a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:30.799649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924c7dc9706f40d68950b634bf64a59a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:30.800807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924c7dc9706f40d68950b634bf64a59a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:30.862842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 858/1722] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:30 2022] DELETE /identity/v3/users/924c7dc9706f40d68950b634bf64a59a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:30.867181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:30.868136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:30.868548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:30.926775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:30.929821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:31.024962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:31.026760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:31.152533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 865/1723] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:31.201160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90e8c-a16c-475d-8c1b-ae268d4920d6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:31.207295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:31.208166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:31.208490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:31.208773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] PATH_INFO: `/v3/projects/d6d6723d077b40fa8ca5e17b3d3ff8c5` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:31.209956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d6723d077b40fa8ca5e17b3d3ff8c5)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:31.243180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:31.292047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:31.293942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:31.317828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d6723d077b40fa8ca5e17b3d3ff8c5', 'request_id': 'req-fd1ba06b-a05d-45aa-a206-70eca3d12141'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.324724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d6723d077b40fa8ca5e17b3d3ff8c5', 'request_id': 'req-fd1ba06b-a05d-45aa-a206-70eca3d12141'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.341567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d6723d077b40fa8ca5e17b3d3ff8c5', 'request_id': 'req-fd1ba06b-a05d-45aa-a206-70eca3d12141'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.370876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff05ae9-24d0-42de-8e77-f7c10103de81 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:31.382847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] The token cache is being invalidate because project d6d6723d077b40fa8ca5e17b3d3ff8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:31.383357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.384488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.388125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 859/1724] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:31 2022] DELETE /identity/v3/projects/d6d6723d077b40fa8ca5e17b3d3ff8c5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:31.392042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:31.394157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:31.486346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba06b-a05d-45aa-a206-70eca3d12141 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:31.490885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:31.491716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:31.492395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:31.507652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] PATH_INFO: `/v3/users/c929298d2024450eb9334d97fb85e1ba` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:31.510590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c929298d2024450eb9334d97fb85e1ba)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:31.522121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:31.522748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:31.523099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:31.523482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:31.532342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:31.546335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:31.577406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:31.626785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c929298d2024450eb9334d97fb85e1ba'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.633825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ca54c-cdeb-4ec4-8cd5-c14e256935f2 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:31.640984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c929298d2024450eb9334d97fb85e1ba'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.661397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 866/1725] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:31.664496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c929298d2024450eb9334d97fb85e1ba'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.665301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c929298d2024450eb9334d97fb85e1ba'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.665899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-22c1887d-e1b7-4860-b7e6-02f3098c7419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c929298d2024450eb9334d97fb85e1ba'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:31.706656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 860/1726] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:31 2022] DELETE /identity/v3/users/c929298d2024450eb9334d97fb85e1ba => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:31.810880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327a6c-e007-4e22-b534-3686a61afbf8 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:31.811298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327a6c-e007-4e22-b534-3686a61afbf8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:31.811596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c327a6c-e007-4e22-b534-3686a61afbf8 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:31.814963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 867/1727] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:47:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:31.865698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:31.865698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:31.865698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:31.901970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:31.903253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:32.054404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 861/1728] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:47:31 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:32.562656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c327a6c-e007-4e22-b534-3686a61afbf8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:32.565124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5c327a6c-e007-4e22-b534-3686a61afbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:32.599256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c327a6c-e007-4e22-b534-3686a61afbf8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:32.607700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:32.608319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:32.608648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:32.608912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:32.626333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:32.652508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:32.676284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 868/1729] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:32 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:33.348993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:33.351161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:33.435542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:33.437224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:33.513639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b05b-13d4-4033-8b79-959f55d0a76c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:33.524815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:33.525889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:33.526313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:33.526790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] PATH_INFO: `/v3/users/d3b2c5a9aeea48ada34ab605b88d6b3d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:33.528260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b2c5a9aeea48ada34ab605b88d6b3d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:33.571935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:33.674424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e38e-4b5e-46ec-8c9f-35791618cef7 service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:33.677350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b2c5a9aeea48ada34ab605b88d6b3d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.686914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:33.687712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:33.688090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:33.688364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] PATH_INFO: `/v3/projects/1ff964b0060e457593a5cb57f46fdbec` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:33.689520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff964b0060e457593a5cb57f46fdbec)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:33.698972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b2c5a9aeea48ada34ab605b88d6b3d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.721850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b2c5a9aeea48ada34ab605b88d6b3d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.722455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b2c5a9aeea48ada34ab605b88d6b3d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.723113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b2c5a9aeea48ada34ab605b88d6b3d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.728601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:33.751790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 862/1730] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:33 2022] DELETE /identity/v3/users/d3b2c5a9aeea48ada34ab605b88d6b3d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:33.751790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:33.753631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:33.805122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff964b0060e457593a5cb57f46fdbec', 'request_id': 'req-8c175860-908b-4567-af2a-66df5598666a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.812525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff964b0060e457593a5cb57f46fdbec', 'request_id': 'req-8c175860-908b-4567-af2a-66df5598666a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.826003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff964b0060e457593a5cb57f46fdbec', 'request_id': 'req-8c175860-908b-4567-af2a-66df5598666a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.886658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] The token cache is being invalidate because project 1ff964b0060e457593a5cb57f46fdbec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:33.886658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.886658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c175860-908b-4567-af2a-66df5598666a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:33.900668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 869/1731] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:33 2022] DELETE /identity/v3/projects/1ff964b0060e457593a5cb57f46fdbec => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:33.902186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:33.902479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:33.902791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:33.908658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87015f6e-b084-4a80-820f-3db0b5def2a6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:33.952537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:33.955140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:33.984806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:33.986365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:33.986997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:33.990232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] PATH_INFO: `/v3/projects/5ecc111b7f384d68bb7329996721683c` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:33.992938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecc111b7f384d68bb7329996721683c)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.054162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:34.075909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 870/1732] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:34.075909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:34.076601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:34.091162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9081853-d59a-4d70-aa8d-f8d9eacff6b4 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:34.104255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:34.105864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.106160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.106733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] PATH_INFO: `/v3/users/d7ad654a24a84b72814984c15388564c` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.107677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ad654a24a84b72814984c15388564c)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.137480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:34.140977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecc111b7f384d68bb7329996721683c', 'request_id': 'req-716a725f-a958-4f03-a421-4233faf2e6d3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.147128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecc111b7f384d68bb7329996721683c', 'request_id': 'req-716a725f-a958-4f03-a421-4233faf2e6d3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.161933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecc111b7f384d68bb7329996721683c', 'request_id': 'req-716a725f-a958-4f03-a421-4233faf2e6d3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.187784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] The token cache is being invalidate because project 5ecc111b7f384d68bb7329996721683c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:34.188111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.196714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.202640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 863/1733] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:33 2022] DELETE /identity/v3/projects/5ecc111b7f384d68bb7329996721683c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:34.203851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:34.205336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:34.224632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ad654a24a84b72814984c15388564c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.247680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ad654a24a84b72814984c15388564c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.249198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ad654a24a84b72814984c15388564c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.272706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ad654a24a84b72814984c15388564c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.287323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2af0248e-2b6d-47b5-a385-a83bddd8d835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ad654a24a84b72814984c15388564c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:34.294436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 871/1734] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:34 2022] DELETE /identity/v3/users/d7ad654a24a84b72814984c15388564c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:34.296035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37742ef-2d4b-4a1d-acd0-2e34ab31c4b7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.296286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37742ef-2d4b-4a1d-acd0-2e34ab31c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.296566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37742ef-2d4b-4a1d-acd0-2e34ab31c4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.300820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a725f-a958-4f03-a421-4233faf2e6d3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:34.325790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e37742ef-2d4b-4a1d-acd0-2e34ab31c4b7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:34.327245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e37742ef-2d4b-4a1d-acd0-2e34ab31c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:34.401980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:34.402680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.402891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.403328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.405562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:34.413619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 872/1735] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:34.421064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.421398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.421728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.425058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.454186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:34.456299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:34.457613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:34.467416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 864/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:34.468206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 873/1737] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:34.472968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:34.482847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325a524-fcf3-4e09-b113-9de606fd037d service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:34.488364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:34.489181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.489475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.489905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.490778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:34.491227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.520540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:34.538625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 865/1738] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:34.540667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:34.553459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8de74-fba4-44b3-8560-e13cf3e30cf7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:34.563691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:34.564768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.567747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.568270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.569238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.643335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:34.705115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 874/1739] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:34 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:34.706107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:34.718175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6dd9-e334-4b17-bea9-bf433009636b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:34.816176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:34.816946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.817751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.818044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.818899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.851297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:34.902234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 866/1740] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:34 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:34.903617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:34.919076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636de33c-3e50-481a-9339-a6cc60c7eef4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:34.928987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33046c3f-405c-4835-808b-2cd782bfae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:34.930000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33046c3f-405c-4835-808b-2cd782bfae20 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:34.932323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33046c3f-405c-4835-808b-2cd782bfae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:34.932630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33046c3f-405c-4835-808b-2cd782bfae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:34.933369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33046c3f-405c-4835-808b-2cd782bfae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:34.998736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33046c3f-405c-4835-808b-2cd782bfae20 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:35.044056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 875/1741] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:35.045949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:35.061963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f170f-991a-4352-b5c4-6df0865b34b2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:35.083341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:35.085402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:35.087115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:35.087115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] PATH_INFO: `/v3/projects/9b487d5f527746ee8c923d25d0893ec9/users/acd056bad5634b6f85d0c38d5a446c34/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:35.119784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b487d5f527746ee8c923d25d0893ec9, user_id=acd056bad5634b6f85d0c38d5a446c34, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:35.150053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:35.181158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 867/1742] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:35 2022] PUT /identity/v3/projects/9b487d5f527746ee8c923d25d0893ec9/users/acd056bad5634b6f85d0c38d5a446c34/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:35.192998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:35.193401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:35.193784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:35.237731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] MFA Rules not processed for user `acd056bad5634b6f85d0c38d5a446c34`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:35.239375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:35.362402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:35.366116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:35.368487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 876/1743] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:35 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:35.379367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:35.380897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:35.506913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd3afb-d3a3-45d4-8a0f-f99e0d2b9a42 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:35.511174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c3aeb-fa05-485f-8ec8-e1a81f0803d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:35.511967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3aeb-fa05-485f-8ec8-e1a81f0803d1 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:35.512396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3aeb-fa05-485f-8ec8-e1a81f0803d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:35.512844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3aeb-fa05-485f-8ec8-e1a81f0803d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:35.537728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8de05-2f5b-4502-80a8-445bcd88405f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:35.538299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c3aeb-fa05-485f-8ec8-e1a81f0803d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:35.551138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:35.552780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:35.553231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:35.553710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] PATH_INFO: `/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:35.557889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf72ac52de2c41acb1f8fb0bfd91dd0d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:35.597158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c3aeb-fa05-485f-8ec8-e1a81f0803d1 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:35.599649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:35.621878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 877/1744] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:35 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:35.727322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf72ac52de2c41acb1f8fb0bfd91dd0d', 'request_id': 'req-eb0179ba-497a-4d89-ae58-21adf9e25546'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:35.737449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf72ac52de2c41acb1f8fb0bfd91dd0d', 'request_id': 'req-eb0179ba-497a-4d89-ae58-21adf9e25546'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:35.754466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf72ac52de2c41acb1f8fb0bfd91dd0d', 'request_id': 'req-eb0179ba-497a-4d89-ae58-21adf9e25546'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:35.792481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] The token cache is being invalidate because project cf72ac52de2c41acb1f8fb0bfd91dd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:35.792772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:35.794825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-eb0179ba-497a-4d89-ae58-21adf9e25546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:35.796532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 868/1745] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:35 2022] DELETE /identity/v3/projects/cf72ac52de2c41acb1f8fb0bfd91dd0d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:35.801336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:35.801848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:35.801937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:35.842868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:35.846334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:35.926071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 878/1746] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:35.933729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:35.934030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:35.934318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:35.984465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:35.985321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:36.005552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 869/1747] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:36.009941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.020629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f549d-1950-4eb7-a3b7-119d08a567c5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.025987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.026858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.027294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.027760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.028595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:36.029043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.058433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.079027 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.085096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 879/1748] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:36.088837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7d4e-ae50-4857-8ff9-962974478a89 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.093773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.094619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.095023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.095413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.096187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.155925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.213121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 870/1749] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:36 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:36.227744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.239238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b96f5-8ca0-49db-94a3-7ebf64b9fb79 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.464916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.465707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.465996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.466277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.466965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.524422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.555053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.566533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 880/1750] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:36 2022] POST /identity/v3/users => generated 284 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:36.567546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06dbad-8164-4bfa-b2b9-d0325cf9113f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.572509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e6d4a-a44f-49a4-bc8a-3f76a3c830c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.573270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e6d4a-a44f-49a4-bc8a-3f76a3c830c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.573786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e6d4a-a44f-49a4-bc8a-3f76a3c830c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.574595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e6d4a-a44f-49a4-bc8a-3f76a3c830c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.575550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e6d4a-a44f-49a4-bc8a-3f76a3c830c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.604223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e6d4a-a44f-49a4-bc8a-3f76a3c830c7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.631412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.632525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 871/1751] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:36.645842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01759d-9b57-463b-b110-0f7e37f6146c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.651493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.653618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.653618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.653618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] PATH_INFO: `/v3/projects/da1048bf45854cdd93480d82d5a96f3e/users/b2183d4c1d344b8c8f4106844fbd04a3/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.690851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1048bf45854cdd93480d82d5a96f3e, user_id=b2183d4c1d344b8c8f4106844fbd04a3, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.719503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.739310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 881/1752] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:36 2022] PUT /identity/v3/projects/da1048bf45854cdd93480d82d5a96f3e/users/b2183d4c1d344b8c8f4106844fbd04a3/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:36.752769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.752769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.752996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.764962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.770120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:36.804121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] MFA Rules not processed for user `b2183d4c1d344b8c8f4106844fbd04a3`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:36.805296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:36.863828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa46e0-5f84-4df3-b091-fa30d5545f87 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.868528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.869315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.869672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.870024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] PATH_INFO: `/v3/projects/b27f768fedfd4f529a5e2fbb7669cef4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.872224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27f768fedfd4f529a5e2fbb7669cef4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.901791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 872/1753] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:36 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:36.902901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:36.903779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.916415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833be9e-e6c1-4330-8bef-a2f430bc070d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:36.920619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:36.921442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:36.921559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:36.921830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:36.922534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:36.950007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:36.975823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27f768fedfd4f529a5e2fbb7669cef4', 'request_id': 'req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:36.983215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27f768fedfd4f529a5e2fbb7669cef4', 'request_id': 'req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:36.991281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 873/1754] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:36 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:36.993157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.008939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27f768fedfd4f529a5e2fbb7669cef4', 'request_id': 'req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.062010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] The token cache is being invalidate because project b27f768fedfd4f529a5e2fbb7669cef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:37.062319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.063590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.068756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 882/1755] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:36 2022] DELETE /identity/v3/projects/b27f768fedfd4f529a5e2fbb7669cef4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:37.070163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.072420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:37.072532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852d82a-5f2a-425b-b92d-afd2896bfa3e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.078023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.078780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.079063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.079348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.080000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.108324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.136524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 874/1756] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:36 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:37.140699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.143076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:37.157008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b756ec-7a18-4664-90f0-8b8c7d3e319f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.162330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.163004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.163446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.163739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.164458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.167787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9880-1b54-43e6-84cb-d9fa8fd9784e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.188024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.188985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.189368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.198523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] PATH_INFO: `/v3/users/12f715c8c1cb42f08f7c0ab78f96eea5` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.198523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f715c8c1cb42f08f7c0ab78f96eea5)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.198751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.203298 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 875/1757] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:37.207662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.218057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3c93-46d3-4a6f-a4c5-d30ee71c825f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.223359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.224212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.224323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.224514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.224950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] PATH_INFO: `/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e/users/64d8e14a985b491e80022a1a79989f13/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.248968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43830a4b52e4be5ae9638cb30b1e17e, user_id=64d8e14a985b491e80022a1a79989f13, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.281749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.303569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 876/1758] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:37 2022] PUT /identity/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e/users/64d8e14a985b491e80022a1a79989f13/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:37.305009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.354378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f715c8c1cb42f08f7c0ab78f96eea5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.375755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f715c8c1cb42f08f7c0ab78f96eea5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.376693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f715c8c1cb42f08f7c0ab78f96eea5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.399532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f715c8c1cb42f08f7c0ab78f96eea5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.417982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f715c8c1cb42f08f7c0ab78f96eea5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:37.432257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 883/1759] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:37 2022] DELETE /identity/v3/users/12f715c8c1cb42f08f7c0ab78f96eea5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:37.533256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90884fc6-416f-4162-aeae-7d1cd55b7071 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.614744 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.615840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.616121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.616406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.617780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.664190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.676892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 877/1760] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:37.681437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.683248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:37.698191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8f0d3-2ca3-4b70-9ecc-1af5ed4dafed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.703161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.704265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.704819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.705206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] PATH_INFO: `/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e/users/64d8e14a985b491e80022a1a79989f13/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.707907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43830a4b52e4be5ae9638cb30b1e17e, user_id=64d8e14a985b491e80022a1a79989f13, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.737165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.750779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 884/1761] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:37 2022] PUT /identity/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e/users/64d8e14a985b491e80022a1a79989f13/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:37.755066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.767978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e33d13-4bba-4eeb-b3cc-00f17d28dd47 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.853291 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6287b-019f-475b-8365-6c5e8cfab35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.854321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6287b-019f-475b-8365-6c5e8cfab35f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.854824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6287b-019f-475b-8365-6c5e8cfab35f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.855429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6287b-019f-475b-8365-6c5e8cfab35f admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.856947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6287b-019f-475b-8365-6c5e8cfab35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.893409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6287b-019f-475b-8365-6c5e8cfab35f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:37.908669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 878/1762] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:37.913976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:37.929638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01452-4073-44e8-a37c-9951bc80650c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:37.946670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:37.947571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:37.948003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:37.948310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] PATH_INFO: `/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e/users/64d8e14a985b491e80022a1a79989f13/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:37.950204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43830a4b52e4be5ae9638cb30b1e17e, user_id=64d8e14a985b491e80022a1a79989f13, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:37.981479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:38.012730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 885/1763] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:37 2022] PUT /identity/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e/users/64d8e14a985b491e80022a1a79989f13/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:38.024230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:38.024230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:38.024230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:38.064105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] MFA Rules not processed for user `64d8e14a985b491e80022a1a79989f13`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:38.064807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:38.161531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 879/1764] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:38 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:38.171695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:38.173986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:38.260287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf66f5-4670-4cad-8c02-2468b6c33fe4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:38.264133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029d6f-fd90-4ea4-adfc-0ce7c32d800b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:38.264939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029d6f-fd90-4ea4-adfc-0ce7c32d800b service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:38.265470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029d6f-fd90-4ea4-adfc-0ce7c32d800b service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:38.265970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029d6f-fd90-4ea4-adfc-0ce7c32d800b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:38.275838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029d6f-fd90-4ea4-adfc-0ce7c32d800b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:38.305541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029d6f-fd90-4ea4-adfc-0ce7c32d800b service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:38.316723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 886/1765] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:38 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:38.455454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:38.464832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b50664-5223-4af0-bf92-089809fdc3a7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:38.468830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:38.469774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:38.470077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:38.470422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:38.472160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:38.560442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:38.590199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5349d-f640-4e75-babd-601632a3e540 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:38.602903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 880/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:38 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:38.644446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c29b4-5f03-4681-a945-d30d7c4a9c7b None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:38.644744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c29b4-5f03-4681-a945-d30d7c4a9c7b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:38.645024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c29b4-5f03-4681-a945-d30d7c4a9c7b None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:38.647049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 887/1767] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:47:38.656935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:38.657433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:38.657688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:38.704751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] MFA Rules not processed for user `2df0c8ccfb9944d4a8d0ccb4745bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:38.707674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:38.897369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 881/1768] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:47:38 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:39.011339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c29b4-5f03-4681-a945-d30d7c4a9c7b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:39.020115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1a9c29b4-5f03-4681-a945-d30d7c4a9c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:39.058842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c29b4-5f03-4681-a945-d30d7c4a9c7b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:39.066036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:39.068178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:39.092136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77399a35-fea4-4230-942d-d850d4db77f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:39.092136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399a35-fea4-4230-942d-d850d4db77f3 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:39.092136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399a35-fea4-4230-942d-d850d4db77f3 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:39.092136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77399a35-fea4-4230-942d-d850d4db77f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:39.134901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399a35-fea4-4230-942d-d850d4db77f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:39.195660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77399a35-fea4-4230-942d-d850d4db77f3 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:39.208771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 888/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:39 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:39.282288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae3a41-c097-444e-8362-f00d0e7e7d83 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:39.295283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:39.300820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:39.301122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:39.303534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] PATH_INFO: `/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:39.306295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee78ba65fa7841a5bc9c463306d0f38e)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:39.385111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:39.455642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee78ba65fa7841a5bc9c463306d0f38e', 'request_id': 'req-862dc35e-8ada-4e03-8362-188607143575'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:39.461852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee78ba65fa7841a5bc9c463306d0f38e', 'request_id': 'req-862dc35e-8ada-4e03-8362-188607143575'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:39.472665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee78ba65fa7841a5bc9c463306d0f38e', 'request_id': 'req-862dc35e-8ada-4e03-8362-188607143575'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:39.494053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] The token cache is being invalidate because project ee78ba65fa7841a5bc9c463306d0f38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:39.494514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:39.495557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-862dc35e-8ada-4e03-8362-188607143575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:39.498102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 882/1770] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:39 2022] DELETE /identity/v3/projects/ee78ba65fa7841a5bc9c463306d0f38e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:39.502062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:39.502426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:39.502801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:39.529270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:39.530438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:39.617250 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 889/1771] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:39.619868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:39.620375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:39.620974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:39.644568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:39.658833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:39.679574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 883/1772] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:39.683762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:39.697799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063433e-fa7f-41b1-bec2-be55ed4ec139 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:39.705692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:39.706736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:39.707440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:39.707919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:39.708861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:39.709537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:39.753825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:39.772124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 890/1773] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:47:39.778487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:39.791523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b4725-803a-4446-91c5-8e7956449863 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:39.818858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:39.822445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:39.825487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:39.825906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:39.826774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:39.873096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:39.908094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 884/1774] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:39 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:39.913941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:39.926463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d2b4-8548-4841-8d72-804571ab00cf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.010225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.011006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.011291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.011657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.012249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.039187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.079082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 891/1775] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:39 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:40.080757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.092510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7e6b2-6bce-4915-bb8f-436c4e09669e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.101117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e47673-31b7-4f01-8857-7ed534bad873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.101734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47673-31b7-4f01-8857-7ed534bad873 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.102473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47673-31b7-4f01-8857-7ed534bad873 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.102973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47673-31b7-4f01-8857-7ed534bad873 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.103689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e47673-31b7-4f01-8857-7ed534bad873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.148083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e47673-31b7-4f01-8857-7ed534bad873 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.165537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 885/1776] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:40.166501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.176768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baba6d-e8f6-4fb0-9355-6b4ee6cb272c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.181063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.181938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.182275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.182895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] PATH_INFO: `/v3/projects/52f5a99890844bf9832c7d75d94baa80/users/8e98f8982b5e4fbbbe7eb0e6f67328a5/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.204694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f5a99890844bf9832c7d75d94baa80, user_id=8e98f8982b5e4fbbbe7eb0e6f67328a5, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.242155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.260485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 892/1777] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:40 2022] PUT /identity/v3/projects/52f5a99890844bf9832c7d75d94baa80/users/8e98f8982b5e4fbbbe7eb0e6f67328a5/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:40.270793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.271084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.271370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.339688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] MFA Rules not processed for user `8e98f8982b5e4fbbbe7eb0e6f67328a5`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:40.342172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:40.424711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 886/1778] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:40 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:40.429121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.496206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f566d37-94eb-4365-8c39-4add48684ab6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.500341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.501040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.501333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.501601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.502234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.527645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.558036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 893/1779] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:40 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:40.559364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.570704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68cdb-3f02-4842-a8cf-d45690871fd3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.638733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.639359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.639670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.639945 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.640575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.668686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.690784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 887/1780] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:40 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:40.694857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.706379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390543-6b2e-4023-9893-150ba47f6431 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.711013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.711618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.711907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.712189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.712891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.738526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.750992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 894/1781] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:40.756271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.765897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4750dc-9919-4e5d-9ff1-cf423aa1be1f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.771608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.772648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.773049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.773399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] PATH_INFO: `/v3/projects/a463f3999c3a4366bbd317c1b87e9168/users/564aacfbd23a4e029623c1ecef9ceb98/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.795290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463f3999c3a4366bbd317c1b87e9168, user_id=564aacfbd23a4e029623c1ecef9ceb98, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.822590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:40.838172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 888/1782] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:40 2022] PUT /identity/v3/projects/a463f3999c3a4366bbd317c1b87e9168/users/564aacfbd23a4e029623c1ecef9ceb98/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:40.842225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:40.852087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba437b0-9026-4170-8b6a-dce543c6a6e7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:40.947877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:40.948547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:40.948836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:40.949120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:40.949824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:40.985380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:41.002249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 895/1783] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:41.008724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:41.027555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cbd19-0547-43a2-9423-cadcfb0d547c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:41.027555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:41.027555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:41.027555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:41.027985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] PATH_INFO: `/v3/projects/a463f3999c3a4366bbd317c1b87e9168/users/564aacfbd23a4e029623c1ecef9ceb98/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:41.027985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463f3999c3a4366bbd317c1b87e9168, user_id=564aacfbd23a4e029623c1ecef9ceb98, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:41.059096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:41.074656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 889/1784] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:41 2022] PUT /identity/v3/projects/a463f3999c3a4366bbd317c1b87e9168/users/564aacfbd23a4e029623c1ecef9ceb98/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:41.078453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:41.103115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eaf0b-a656-4df2-8ac2-19f4575cce03 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:41.187466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570c9f8-d632-484e-9ca0-343cfdd1d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:41.189282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c9f8-d632-484e-9ca0-343cfdd1d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:41.189589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c9f8-d632-484e-9ca0-343cfdd1d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:41.189904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570c9f8-d632-484e-9ca0-343cfdd1d1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:41.190666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570c9f8-d632-484e-9ca0-343cfdd1d1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:41.236496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570c9f8-d632-484e-9ca0-343cfdd1d1ee admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:41.249099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 896/1785] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:41.253044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:41.273751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb4a7-0d02-4fa0-8fc2-1e5165a4d7bb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:41.281829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:41.283899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:41.286035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:41.286525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] PATH_INFO: `/v3/projects/a463f3999c3a4366bbd317c1b87e9168/users/564aacfbd23a4e029623c1ecef9ceb98/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:41.292676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463f3999c3a4366bbd317c1b87e9168, user_id=564aacfbd23a4e029623c1ecef9ceb98, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:41.325653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:41.345320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 890/1786] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:41 2022] PUT /identity/v3/projects/a463f3999c3a4366bbd317c1b87e9168/users/564aacfbd23a4e029623c1ecef9ceb98/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:41.356915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:41.357332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:41.357703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:41.399546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] MFA Rules not processed for user `564aacfbd23a4e029623c1ecef9ceb98`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:41.400795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:41.555330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 897/1787] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:41 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:41.575933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:41.577896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:41.672610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355377ae-ba85-486b-955d-2e0fb60eadf3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:41.679347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0980bc2-6c4e-4b8e-bbd4-0f567317092d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:41.680238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980bc2-6c4e-4b8e-bbd4-0f567317092d service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:41.680797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980bc2-6c4e-4b8e-bbd4-0f567317092d service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:41.681440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0980bc2-6c4e-4b8e-bbd4-0f567317092d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:41.697840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980bc2-6c4e-4b8e-bbd4-0f567317092d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:41.724168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0980bc2-6c4e-4b8e-bbd4-0f567317092d service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:41.735509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 891/1788] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:41 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:42.971723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:43.110155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81912-9da5-4dd4-b8a9-84cd8e96efda None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:43.116084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:43.118047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:43.118213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:43.119031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] PATH_INFO: `/v3/users/8e98f8982b5e4fbbbe7eb0e6f67328a5` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:43.120436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e98f8982b5e4fbbbe7eb0e6f67328a5)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:43.152823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:43.281163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e98f8982b5e4fbbbe7eb0e6f67328a5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:43.296840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e98f8982b5e4fbbbe7eb0e6f67328a5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:43.297832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e98f8982b5e4fbbbe7eb0e6f67328a5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:43.323256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e98f8982b5e4fbbbe7eb0e6f67328a5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:43.340351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e98f8982b5e4fbbbe7eb0e6f67328a5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:43.354267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 898/1789] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:42 2022] DELETE /identity/v3/users/8e98f8982b5e4fbbbe7eb0e6f67328a5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:43.358594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:43.359455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:43.359991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:43.407858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:43.409169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:43.532180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 892/1790] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:43.551173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:43.552951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:43.671927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4371cb-3dbf-48d8-a83e-907cdb732b50 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:43.676058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:43.676938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:43.677089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:43.677346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:43.693142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:43.721803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:43.736062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 899/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:44.841533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:44.843167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:44.855046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce000af-99d9-4027-ae5f-b27ae7349bf2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:44.859904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:44.861909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:44.862401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:44.862884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] PATH_INFO: `/v3/projects/52f5a99890844bf9832c7d75d94baa80` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:44.875692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f5a99890844bf9832c7d75d94baa80)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:44.910969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:44.987854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f5a99890844bf9832c7d75d94baa80', 'request_id': 'req-a0cc534e-c09c-4374-bdc4-406ca73aeb07'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:44.992778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f5a99890844bf9832c7d75d94baa80', 'request_id': 'req-a0cc534e-c09c-4374-bdc4-406ca73aeb07'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.002855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f5a99890844bf9832c7d75d94baa80', 'request_id': 'req-a0cc534e-c09c-4374-bdc4-406ca73aeb07'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.019878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] The token cache is being invalidate because project 52f5a99890844bf9832c7d75d94baa80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:45.020159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.020758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.022457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 893/1792] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:44 2022] DELETE /identity/v3/projects/52f5a99890844bf9832c7d75d94baa80 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:45.026172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:45.039819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3a5d3-332e-4ed2-a666-53943bdf60e5 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:45.105168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:45.105981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:45.106273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:45.106578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] PATH_INFO: `/v3/users/564aacfbd23a4e029623c1ecef9ceb98` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:45.107709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] RBAC: Authorizing `identity:delete_user(user_id=564aacfbd23a4e029623c1ecef9ceb98)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:45.133251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:45.187665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564aacfbd23a4e029623c1ecef9ceb98'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.196332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564aacfbd23a4e029623c1ecef9ceb98'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.197065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564aacfbd23a4e029623c1ecef9ceb98'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.210435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564aacfbd23a4e029623c1ecef9ceb98'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.217992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4f8a21f3-4455-4791-b1ed-1e708a4df00d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564aacfbd23a4e029623c1ecef9ceb98'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:45.224053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 900/1793] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:45 2022] DELETE /identity/v3/users/564aacfbd23a4e029623c1ecef9ceb98 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:45.831516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:45.832967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:45.848141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc534e-c09c-4374-bdc4-406ca73aeb07 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:45.948364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:45.949487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:45.949992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:45.950650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] PATH_INFO: `/v3/projects/a463f3999c3a4366bbd317c1b87e9168` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:45.951891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a463f3999c3a4366bbd317c1b87e9168)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:45.978863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:46.047101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a463f3999c3a4366bbd317c1b87e9168', 'request_id': 'req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:46.053019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a463f3999c3a4366bbd317c1b87e9168', 'request_id': 'req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:46.061017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a463f3999c3a4366bbd317c1b87e9168', 'request_id': 'req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:46.080114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] The token cache is being invalidate because project a463f3999c3a4366bbd317c1b87e9168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:46.080633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:46.081062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a7ed8c4d-0ce2-4a63-81a4-24b30da4a8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:46.082881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 894/1794] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:45 2022] DELETE /identity/v3/projects/a463f3999c3a4366bbd317c1b87e9168 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:46.087927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.089074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.089716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.120937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:46.122687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:46.224254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 901/1795] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:46.232086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.232405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.232676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.268840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:46.270042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:46.277270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 895/1796] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:46.281860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:46.291439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd0463-1cb3-45f9-b8f0-ac367b1e1ec8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:46.296175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:46.296762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.297062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.297506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.298329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:46.298653 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:46.324318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:46.338364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 902/1797] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:46.344247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:46.353736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447904e6-6e17-4049-8ade-8435e0ff48a9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:46.358680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:46.359350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.359770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.360047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.360747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:46.386523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:46.420740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 896/1798] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:46 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:46.425070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:46.435239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc3538-d521-4954-9cfb-aade5b1351f3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:46.501402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:46.502005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.502361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.502579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.503220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:46.528951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:46.550195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 903/1799] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:46 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:46.555529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:46.567181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a468f2-fd29-48f9-a146-3dd55da72550 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:46.572196 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067554f4-8c17-437c-9228-bf78a49bc563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:46.572870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067554f4-8c17-437c-9228-bf78a49bc563 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.573257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067554f4-8c17-437c-9228-bf78a49bc563 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.573721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067554f4-8c17-437c-9228-bf78a49bc563 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.574633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067554f4-8c17-437c-9228-bf78a49bc563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:46.602387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067554f4-8c17-437c-9228-bf78a49bc563 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:46.613959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 897/1800] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:46.618245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:46.628776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f18ba-34da-47f3-95b6-c0d5ba38c28c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:46.634011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:46.634890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.635176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.635483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] PATH_INFO: `/v3/projects/21606776b4a34da892606df39cf8eb6f/users/4d5f5d0ff80b437da26ee5899dfe8031/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.657415 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=21606776b4a34da892606df39cf8eb6f, user_id=4d5f5d0ff80b437da26ee5899dfe8031, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:46.691008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:46.714809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 904/1801] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:46 2022] PUT /identity/v3/projects/21606776b4a34da892606df39cf8eb6f/users/4d5f5d0ff80b437da26ee5899dfe8031/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:46.728593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:46.728915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:46.729167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:46.832715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:46.833988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] MFA Rules not processed for user `4d5f5d0ff80b437da26ee5899dfe8031`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:46.834745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:46.836052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:46.954986 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 898/1802] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:46 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:46.956024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.027099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bd8db-9435-4227-a49e-0be7122530ba admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.039462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.040401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.040927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.042600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] PATH_INFO: `/v3/users/acd056bad5634b6f85d0c38d5a446c34` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.042755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd056bad5634b6f85d0c38d5a446c34)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.084816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.089931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3504e-4a36-4d34-aaac-57b3b7165c2e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.095985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.097144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.097576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.097992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.099287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.137359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.169603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd056bad5634b6f85d0c38d5a446c34'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:47.179813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd056bad5634b6f85d0c38d5a446c34'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:47.182584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd056bad5634b6f85d0c38d5a446c34'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:47.202296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd056bad5634b6f85d0c38d5a446c34'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:47.209485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 899/1803] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:46 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:47.212655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.213148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f063c006-1daa-47b7-8772-c82ef470ce2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd056bad5634b6f85d0c38d5a446c34'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:47.224576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 905/1804] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:46 2022] DELETE /identity/v3/users/acd056bad5634b6f85d0c38d5a446c34 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:47.229809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.230458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.230944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.270381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:47.271714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:47.385557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d385ee4-5236-4c56-a76c-f7e8fd793341 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.414179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 906/1805] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:47.425113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.426448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:47.502174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.513915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.514133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.515585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.516695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.568612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.572842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759addd-410a-4367-b2f8-7662d861c7ad None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.576284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.576874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.577340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.577626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.591168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.607519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 900/1806] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:47 2022] POST /identity/v3/users => generated 297 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:47.613106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.616149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:47.618809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.628928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fc552-408f-4481-9c9d-90b5c03e7074 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.629228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 907/1807] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:47.634500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.635462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.635909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.636197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.636906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.668228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.687004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 901/1808] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:47.688369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.698635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ebd0c-cf3f-4067-a316-15c014ae3f91 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.703485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.704591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.704954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.705242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] PATH_INFO: `/v3/projects/df6b9397c0c1492c8208e644ce4c27fc/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.728121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6b9397c0c1492c8208e644ce4c27fc, user_id=d2a1ed8ebfdc48ff9a3e77fc6b4a220b, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.754635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.770109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 908/1809] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:47 2022] PUT /identity/v3/projects/df6b9397c0c1492c8208e644ce4c27fc/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:47.773874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.787373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d680a82-c8c0-4f45-950b-6d1d684b56f8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.870500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.871722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.871722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.872076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.873052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:47.900887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:47.913248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 902/1810] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:47.918605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:47.931306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c3b6-0ef6-471d-b067-f8b6b0167f57 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:47.936616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:47.937488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:47.937881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:47.938170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] PATH_INFO: `/v3/projects/df6b9397c0c1492c8208e644ce4c27fc/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:47.940554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6b9397c0c1492c8208e644ce4c27fc, user_id=d2a1ed8ebfdc48ff9a3e77fc6b4a220b, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.003557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.033911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 909/1811] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:47 2022] PUT /identity/v3/projects/df6b9397c0c1492c8208e644ce4c27fc/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:48.034274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.048993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171a019-4b0e-4cbb-8600-e1ac0b136c57 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.158163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.158815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.159109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.159549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.160292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.178577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.180233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.200869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.201849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7368-dfda-4691-a090-8798d43c3d20 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.210352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.211052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.211343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.211627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] PATH_INFO: `/v3/users/b2183d4c1d344b8c8f4106844fbd04a3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.212797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2183d4c1d344b8c8f4106844fbd04a3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.218935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 903/1812] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:48.220270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.223654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.236993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd703-ad43-4502-aff3-b2fc9ff485da admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.243103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.244324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.244939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.245565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] PATH_INFO: `/v3/projects/9b487d5f527746ee8c923d25d0893ec9` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.246890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b487d5f527746ee8c923d25d0893ec9)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.259150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.277011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.358953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b487d5f527746ee8c923d25d0893ec9', 'request_id': 'req-749f967f-4ac0-412b-ad96-864b9b27ba9e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.365499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b487d5f527746ee8c923d25d0893ec9', 'request_id': 'req-749f967f-4ac0-412b-ad96-864b9b27ba9e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.376871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b487d5f527746ee8c923d25d0893ec9', 'request_id': 'req-749f967f-4ac0-412b-ad96-864b9b27ba9e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.397371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2183d4c1d344b8c8f4106844fbd04a3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.409406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2183d4c1d344b8c8f4106844fbd04a3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.410465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2183d4c1d344b8c8f4106844fbd04a3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.414846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] The token cache is being invalidate because project 9b487d5f527746ee8c923d25d0893ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:48.416481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.418645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.421727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 904/1813] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:48 2022] DELETE /identity/v3/projects/9b487d5f527746ee8c923d25d0893ec9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:48.423064 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.424568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.436073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2183d4c1d344b8c8f4106844fbd04a3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.454044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-357b3da5-8507-4eb6-930f-4f31d626053d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2183d4c1d344b8c8f4106844fbd04a3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:48.463711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 910/1814] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:48 2022] DELETE /identity/v3/users/b2183d4c1d344b8c8f4106844fbd04a3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:48.468707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881098d2-1574-4cc2-9055-d5ec45059742 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.469294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881098d2-1574-4cc2-9055-d5ec45059742 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.469775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881098d2-1574-4cc2-9055-d5ec45059742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.494759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-881098d2-1574-4cc2-9055-d5ec45059742 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:48.496284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-881098d2-1574-4cc2-9055-d5ec45059742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.519461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f967f-4ac0-412b-ad96-864b9b27ba9e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.597793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 911/1815] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:48.599691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec847-5dea-4dee-a076-cf92db83ac16 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.600742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec847-5dea-4dee-a076-cf92db83ac16 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.601317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaec847-5dea-4dee-a076-cf92db83ac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.620551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.621388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.621680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.621965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] PATH_INFO: `/v3/projects/df6b9397c0c1492c8208e644ce4c27fc/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.624546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6b9397c0c1492c8208e644ce4c27fc, user_id=d2a1ed8ebfdc48ff9a3e77fc6b4a220b, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.640267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-aeaec847-5dea-4dee-a076-cf92db83ac16 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:48.643683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-aeaec847-5dea-4dee-a076-cf92db83ac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.655802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 912/1816] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:48.656070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.656171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779cf7c-986c-4c98-86bf-4079300346a5 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.656171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779cf7c-986c-4c98-86bf-4079300346a5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.656171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779cf7c-986c-4c98-86bf-4079300346a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.675602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 905/1817] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:48 2022] PUT /identity/v3/projects/df6b9397c0c1492c8208e644ce4c27fc/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:48.686420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d779cf7c-986c-4c98-86bf-4079300346a5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:48.686539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.688656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d779cf7c-986c-4c98-86bf-4079300346a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.691082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.783475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 913/1818] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:48.783475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681078-23a0-4579-89f9-d036897900ec None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.783475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681078-23a0-4579-89f9-d036897900ec None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.783475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f681078-23a0-4579-89f9-d036897900ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.811437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3caa-9630-4b57-ba95-9e5f047ff66e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.819520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6f681078-23a0-4579-89f9-d036897900ec None None] MFA Rules not processed for user `d2a1ed8ebfdc48ff9a3e77fc6b4a220b`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:48.819830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.820456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.821045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.821332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.823057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6f681078-23a0-4579-89f9-d036897900ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.838261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.873523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.885679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 906/1819] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:48.886784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.898498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8431943-1be6-4e00-8f91-443d52094dd4 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.905001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.905948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.906465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.907066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.908198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:48.909478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:48.932497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 914/1820] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:48 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:48.938302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f681078-23a0-4579-89f9-d036897900ec None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.939849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6f681078-23a0-4579-89f9-d036897900ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:48.943974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:48.961274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 907/1821] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:48.967594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:48.979787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40940e-cc62-449f-86e8-1b32b0afb07c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:48.984866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:48.985694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:48.986635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:48.987232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:48.988207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:49.020544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:49.061828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 908/1822] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:48 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:49.064216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:49.091621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f681078-23a0-4579-89f9-d036897900ec None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:49.229440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f100-5a55-4c78-a692-5cecd0a30012 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:49.239826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:49.240505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.240910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.241080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.244158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:49.244848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:49.245941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.246374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.246873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.310533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:49.336681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:49.342739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 909/1823] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:49 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:49.346331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:49.358187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f051d-818b-4aed-a107-2e82234f649b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:49.364888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:49.365584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.365879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.366162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.366964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:49.369964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:49.387626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 915/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:48 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:49.420309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:49.434719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 910/1825] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:49.438531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:49.450248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246d8f-e38b-4082-82a3-c47a279fc8c2 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:49.456140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf03e5-f7ec-4477-8b9b-8e079e01589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:49.457097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf03e5-f7ec-4477-8b9b-8e079e01589a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.457453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf03e5-f7ec-4477-8b9b-8e079e01589a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.457834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf03e5-f7ec-4477-8b9b-8e079e01589a admin admin] PATH_INFO: `/v3/projects/20d28e0c22ce471a80ade56e81096634/users/e45805b80e634b388d17c1221373c2fd/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.487478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf03e5-f7ec-4477-8b9b-8e079e01589a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d28e0c22ce471a80ade56e81096634, user_id=e45805b80e634b388d17c1221373c2fd, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:49.556980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:49.558786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:49.571394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf03e5-f7ec-4477-8b9b-8e079e01589a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:49.584905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a663a6d-ae8f-46c5-83a8-06b4545ee892 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:49.596078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:49.597621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.598946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.600183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] PATH_INFO: `/v3/projects/da1048bf45854cdd93480d82d5a96f3e` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.603929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1048bf45854cdd93480d82d5a96f3e)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:49.615589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 916/1826] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:49 2022] PUT /identity/v3/projects/20d28e0c22ce471a80ade56e81096634/users/e45805b80e634b388d17c1221373c2fd/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:49.626929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.627672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.628157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.651220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:49.721720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] MFA Rules not processed for user `e45805b80e634b388d17c1221373c2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:49.726294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:49.758790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1048bf45854cdd93480d82d5a96f3e', 'request_id': 'req-c6a9661a-e430-41df-910e-1e178f82ebca'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:49.765608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1048bf45854cdd93480d82d5a96f3e', 'request_id': 'req-c6a9661a-e430-41df-910e-1e178f82ebca'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:49.777875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1048bf45854cdd93480d82d5a96f3e', 'request_id': 'req-c6a9661a-e430-41df-910e-1e178f82ebca'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:49.801887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] The token cache is being invalidate because project da1048bf45854cdd93480d82d5a96f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:49.802342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:49.802981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:49.804875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 911/1827] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:49 2022] DELETE /identity/v3/projects/da1048bf45854cdd93480d82d5a96f3e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:49.808138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:49.808138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:49.877864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 917/1828] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:49 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:49.878916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:49.880142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:49.909783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9661a-e430-41df-910e-1e178f82ebca admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:49.915514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:49.916716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:49.917304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:49.917738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:49.920335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:49.957324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91bc88-c5aa-47e8-9bee-8e01b58ff37f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:50.014403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:50.029148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:50.029892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:50.030176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:50.030635 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] PATH_INFO: `/v3/users/64d8e14a985b491e80022a1a79989f13` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:50.031853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d8e14a985b491e80022a1a79989f13)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:50.041491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:50.051328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 912/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:49 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:50.053828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:50.055087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:50.057455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:50.065255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de1d9-7a08-458e-abf5-3205dc41a05b service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:50.068893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984e643-f7e3-4171-880b-3c45ccd79e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:50.069827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984e643-f7e3-4171-880b-3c45ccd79e95 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:50.069827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984e643-f7e3-4171-880b-3c45ccd79e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:50.070052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984e643-f7e3-4171-880b-3c45ccd79e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:50.124688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d8e14a985b491e80022a1a79989f13'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:50.134828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d8e14a985b491e80022a1a79989f13'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:50.136030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d8e14a985b491e80022a1a79989f13'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:50.145863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984e643-f7e3-4171-880b-3c45ccd79e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:50.151834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d8e14a985b491e80022a1a79989f13'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:50.160378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d8e14a985b491e80022a1a79989f13'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:50.167932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 918/1830] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:49 2022] DELETE /identity/v3/users/64d8e14a985b491e80022a1a79989f13 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:50.177621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984e643-f7e3-4171-880b-3c45ccd79e95 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:50.188265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 913/1831] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:50 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:50.729360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:50.731084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:50.878403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2b8fa-db32-4641-8ad4-b1fe88844b20 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:50.883080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:50.884351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:50.884769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:50.885149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] PATH_INFO: `/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:50.886477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43830a4b52e4be5ae9638cb30b1e17e)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:50.920608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:50.989760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43830a4b52e4be5ae9638cb30b1e17e', 'request_id': 'req-8c7eeb43-ad38-40a9-b885-45b279437825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:50.997181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43830a4b52e4be5ae9638cb30b1e17e', 'request_id': 'req-8c7eeb43-ad38-40a9-b885-45b279437825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.006504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43830a4b52e4be5ae9638cb30b1e17e', 'request_id': 'req-8c7eeb43-ad38-40a9-b885-45b279437825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.032167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] The token cache is being invalidate because project a43830a4b52e4be5ae9638cb30b1e17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:51.032570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.033365 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.034941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 919/1832] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:50 2022] DELETE /identity/v3/projects/a43830a4b52e4be5ae9638cb30b1e17e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:51.039895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1f765-d323-4970-bad0-bb4221bfe06b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.040433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1f765-d323-4970-bad0-bb4221bfe06b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.040882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1f765-d323-4970-bad0-bb4221bfe06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.073482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ddc1f765-d323-4970-bad0-bb4221bfe06b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:51.074825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ddc1f765-d323-4970-bad0-bb4221bfe06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:51.217787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 914/1833] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:51.219471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.221251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:51.225659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.225959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.226600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.249610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eeb43-ad38-40a9-b885-45b279437825 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.261150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.263420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.263716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.265117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] PATH_INFO: `/v3/users/4d5f5d0ff80b437da26ee5899dfe8031` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.268219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5f5d0ff80b437da26ee5899dfe8031)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.289052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:51.290397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:51.298647 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.307782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 915/1834] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:51.311735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.327665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571700d8-7a8d-4eea-918c-58a0b7af8d78 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.342228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.343014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.343361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.343704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.344542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:51.344919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.372726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5f5d0ff80b437da26ee5899dfe8031'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.373004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.385832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5f5d0ff80b437da26ee5899dfe8031'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.386585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5f5d0ff80b437da26ee5899dfe8031'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.399694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 916/1835] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:51.403219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.411669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5f5d0ff80b437da26ee5899dfe8031'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.420171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19621-579d-40c5-8869-755ce4da5e48 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.433091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.433699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.433989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.434259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.434924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.441544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0f61caa5-dad9-4833-baba-063c550becd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5f5d0ff80b437da26ee5899dfe8031'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:51.451488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 920/1836] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:51 2022] DELETE /identity/v3/users/4d5f5d0ff80b437da26ee5899dfe8031 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:51.457651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.458083 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.458973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.470834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.486881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:51.488330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:51.510792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 917/1837] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:51 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:51.517464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.520470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:51.579534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 921/1838] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:51.589994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.592825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:51.626329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1b199-f296-40c2-9ebf-1056d08c60f4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.630908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.631607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.632712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.633078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.633835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.680786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.718740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 918/1839] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:51 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:51.723368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.729555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fdf03-72d8-43ac-912f-03b504a85450 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.741236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc63d28-36d5-4d50-aa2f-04e967996a85 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.746732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.747360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.747901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.748186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.750176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.811661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.844878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 919/1840] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:51.845991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:51.856201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2177fe-7545-4e31-bbd7-45f121445e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.857171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2177fe-7545-4e31-bbd7-45f121445e6e service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.857616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2177fe-7545-4e31-bbd7-45f121445e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.859261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2177fe-7545-4e31-bbd7-45f121445e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.866492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c042e0-fa2f-40cb-aa2e-c2d3afda976d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:51.872687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:51.873930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.874343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.874772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] PATH_INFO: `/v3/projects/01c36d33ee5c468b9bba1828bb84b8e0/users/3dac764de6054b0faa55cd815d5d8342/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:51.893340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2177fe-7545-4e31-bbd7-45f121445e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.918798 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c36d33ee5c468b9bba1828bb84b8e0, user_id=3dac764de6054b0faa55cd815d5d8342, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:51.947943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.950629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2177fe-7545-4e31-bbd7-45f121445e6e service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:51.966537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 922/1841] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:51.986591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 920/1842] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:51 2022] PUT /identity/v3/projects/01c36d33ee5c468b9bba1828bb84b8e0/users/3dac764de6054b0faa55cd815d5d8342/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:51.986814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:51.986913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:51.987197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.083935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] MFA Rules not processed for user `3dac764de6054b0faa55cd815d5d8342`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:52.085168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:52.300623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 923/1843] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:51 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:52.305021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.412431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a727f2-0333-4d53-82d8-4a07c40db814 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:52.416947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:52.417619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:52.417973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:52.418428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.419173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:52.449350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:52.483352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 921/1844] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:52 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:52.487396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.499418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0e36-edeb-4732-95b5-77059019aad2 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:52.557641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.559609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:52.591119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:52.591898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:52.592198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:52.592502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.593200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:52.638319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:52.675690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 924/1845] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:52 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:52.679846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.688935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683600-9b0b-421e-9154-ce499d743ed9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:52.694269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:52.695271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:52.695872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:52.696152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] PATH_INFO: `/v3/projects/21606776b4a34da892606df39cf8eb6f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.697258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21606776b4a34da892606df39cf8eb6f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:52.700118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55b8bd-fa21-4cd6-8592-d07d59fc6632 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:52.705548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:52.706871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:52.707398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:52.707881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.708835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:52.723338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:52.738435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:52.756221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 925/1846] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:52.757557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.773504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c22be-c909-400e-9420-dbd5f859345c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:52.778722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21606776b4a34da892606df39cf8eb6f', 'request_id': 'req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:52.785223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21606776b4a34da892606df39cf8eb6f', 'request_id': 'req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:52.804885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21606776b4a34da892606df39cf8eb6f', 'request_id': 'req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:52.817804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] The token cache is being invalidate because project 21606776b4a34da892606df39cf8eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:52.818096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:52.819378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:52.821300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 922/1847] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:52 2022] DELETE /identity/v3/projects/21606776b4a34da892606df39cf8eb6f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:52.826525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.831846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:52.862972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:52.863810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:52.864095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:52.864373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] PATH_INFO: `/v3/projects/82941761c8324572a8d0445b00806825/users/8376b9f85bae458891b86e3c30e839c8/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.887358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82941761c8324572a8d0445b00806825, user_id=8376b9f85bae458891b86e3c30e839c8, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:52.916524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:52.918847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a49d3-23e7-49cf-a571-a75905f1c7c6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:52.924655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:52.925613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:52.925830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:52.926539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] PATH_INFO: `/v3/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:52.927360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a1ed8ebfdc48ff9a3e77fc6b4a220b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:52.937215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 926/1848] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:52 2022] PUT /identity/v3/projects/82941761c8324572a8d0445b00806825/users/8376b9f85bae458891b86e3c30e839c8/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:52.941367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:52.943755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:52.959622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:53.024606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a1ed8ebfdc48ff9a3e77fc6b4a220b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.027169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750332-f8bf-4d8f-82ed-95b74691cc8d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:53.032860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:53.033579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.033985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.034104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a1ed8ebfdc48ff9a3e77fc6b4a220b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.034435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.035388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:53.044520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a1ed8ebfdc48ff9a3e77fc6b4a220b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.045968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a1ed8ebfdc48ff9a3e77fc6b4a220b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.046900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a1ed8ebfdc48ff9a3e77fc6b4a220b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.064748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:53.079162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 927/1849] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:53.079425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 923/1850] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:52 2022] DELETE /identity/v3/users/d2a1ed8ebfdc48ff9a3e77fc6b4a220b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:53.086869 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:53.088704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:53.100909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aa6fa-f630-4ee8-b106-a45722cd4189 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:53.175173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:53.177258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.179339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.179809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] PATH_INFO: `/v3/projects/82941761c8324572a8d0445b00806825/users/8376b9f85bae458891b86e3c30e839c8/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.182904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82941761c8324572a8d0445b00806825, user_id=8376b9f85bae458891b86e3c30e839c8, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:53.223872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:53.236248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 928/1851] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:53 2022] PUT /identity/v3/projects/82941761c8324572a8d0445b00806825/users/8376b9f85bae458891b86e3c30e839c8/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:53.240304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:53.251975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363593-6287-4be0-9e36-fb74266b20e3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:53.340808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f623a0-a2aa-4a9e-bf89-4cfb0484bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:53.341475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f623a0-a2aa-4a9e-bf89-4cfb0484bd05 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.341771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f623a0-a2aa-4a9e-bf89-4cfb0484bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.342058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f623a0-a2aa-4a9e-bf89-4cfb0484bd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.342796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f623a0-a2aa-4a9e-bf89-4cfb0484bd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:53.370352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f623a0-a2aa-4a9e-bf89-4cfb0484bd05 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:53.382754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 924/1852] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:53.386596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:53.397201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a56e65-efc3-477b-9bd4-f64f13a376c5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:53.402186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:53.403204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.404027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.404453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] PATH_INFO: `/v3/projects/82941761c8324572a8d0445b00806825/users/8376b9f85bae458891b86e3c30e839c8/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.406900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82941761c8324572a8d0445b00806825, user_id=8376b9f85bae458891b86e3c30e839c8, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:53.444668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:53.474603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 929/1853] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:53 2022] PUT /identity/v3/projects/82941761c8324572a8d0445b00806825/users/8376b9f85bae458891b86e3c30e839c8/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:53.483799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.484111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.484411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.542229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:53.544067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:53.596261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] MFA Rules not processed for user `8376b9f85bae458891b86e3c30e839c8`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:53.597030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:53.693195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 925/1854] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:53 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:53.707402 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735db15-e776-4468-862d-5b0f825337f1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:53.715212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:53.715992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.716276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.716557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] PATH_INFO: `/v3/projects/df6b9397c0c1492c8208e644ce4c27fc` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.719735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:53.720039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6b9397c0c1492c8208e644ce4c27fc)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:53.722190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:53.782734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:53.879501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c6103-9ae6-4672-8d7b-88cdbf1bab0c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:53.881893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6b9397c0c1492c8208e644ce4c27fc', 'request_id': 'req-6710a241-acec-4014-b2d7-7198d4fbb3e3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.900393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6b9397c0c1492c8208e644ce4c27fc', 'request_id': 'req-6710a241-acec-4014-b2d7-7198d4fbb3e3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.913263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6b9397c0c1492c8208e644ce4c27fc', 'request_id': 'req-6710a241-acec-4014-b2d7-7198d4fbb3e3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.937225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] The token cache is being invalidate because project df6b9397c0c1492c8208e644ce4c27fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:53.937714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.939138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6710a241-acec-4014-b2d7-7198d4fbb3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:53.941134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 930/1855] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:53 2022] DELETE /identity/v3/projects/df6b9397c0c1492c8208e644ce4c27fc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:53.946952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b45e-ec11-4b64-957b-835317ad1a63 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:53.947158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b45e-ec11-4b64-957b-835317ad1a63 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:53.947532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b45e-ec11-4b64-957b-835317ad1a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:53.992556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-57a6b45e-ec11-4b64-957b-835317ad1a63 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:53.994576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-57a6b45e-ec11-4b64-957b-835317ad1a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:54.000804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.001518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.001962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.002250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.004576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:54.104307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.104958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 931/1856] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:54.106508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.106975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.107396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.130077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.132355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:54.133426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:54.140678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 932/1857] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:54.145437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.148199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 926/1858] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:53 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:54.154759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4a511-2f90-41e9-b8df-cf52929c9025 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.159316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.160010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.160387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.160757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.161557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:54.161959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.187049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.209634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 933/1859] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:54.210808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.222032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed231dd-d283-4945-8880-94ebd7306632 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.227156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.227758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.228044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.228323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.228961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.256334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.287728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 927/1860] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:54 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:54.288832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.298348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a51bdf-a08f-4e4e-abae-40e1e1bf2e86 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.363337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.363964 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.364323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.364672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.365394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.391934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.418309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 934/1861] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:54 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:54.419602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.429977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc73206-05ee-4f3b-b855-4bf1588812e1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.434250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d40c3e-ad5d-4290-8f42-9c2d6339a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.434859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d40c3e-ad5d-4290-8f42-9c2d6339a660 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.435140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d40c3e-ad5d-4290-8f42-9c2d6339a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.435422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d40c3e-ad5d-4290-8f42-9c2d6339a660 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.436102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d40c3e-ad5d-4290-8f42-9c2d6339a660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.462166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d40c3e-ad5d-4290-8f42-9c2d6339a660 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.472640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 928/1862] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:54.477164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.487030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0ee49-227e-4304-b299-8dac452154d9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.491612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.492517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.492799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.493077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] PATH_INFO: `/v3/projects/8237a4732a5749d6a69d5753eb722198/users/761019e9e63a499eb6a4c48fa0213e0a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.513442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8237a4732a5749d6a69d5753eb722198, user_id=761019e9e63a499eb6a4c48fa0213e0a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.540580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.558798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 935/1863] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:54 2022] PUT /identity/v3/projects/8237a4732a5749d6a69d5753eb722198/users/761019e9e63a499eb6a4c48fa0213e0a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:54.569219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.569617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.569994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.618423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] MFA Rules not processed for user `761019e9e63a499eb6a4c48fa0213e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:54.619698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:54.649951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.651801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:54.725833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 929/1864] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:54 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:54.732148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.733489 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:54.744075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfa4e7-4672-4400-9ae6-d2a8686ba50a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.749126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.750084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.750473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.750954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] PATH_INFO: `/v3/users/e45805b80e634b388d17c1221373c2fd` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.752490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45805b80e634b388d17c1221373c2fd)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.786907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.811840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6ee8d-f3dc-4748-b15f-9c0ddf0aa3f0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.815906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:54.816769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.817204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.817725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.845504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:54.858455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45805b80e634b388d17c1221373c2fd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:54.871167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45805b80e634b388d17c1221373c2fd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:54.871823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45805b80e634b388d17c1221373c2fd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:54.873230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:54.885679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 930/1865] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:54 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:54.892303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45805b80e634b388d17c1221373c2fd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:54.905331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-64fc4975-dfaf-42d1-bcaf-49019d2b13ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45805b80e634b388d17c1221373c2fd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:54.912264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:54.915670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 936/1866] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:54 2022] DELETE /identity/v3/users/e45805b80e634b388d17c1221373c2fd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:54.917122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:54.917523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:54.918027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:54.926820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885de81-100a-4137-9944-dbce483610b9 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:54.969022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:54.970355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:55.037824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:55.039266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:55.039700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:55.040290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] PATH_INFO: `/v3/users/761019e9e63a499eb6a4c48fa0213e0a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:55.043110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=761019e9e63a499eb6a4c48fa0213e0a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:55.072511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:55.088343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 937/1867] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:55.100580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:55.102055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:55.136980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761019e9e63a499eb6a4c48fa0213e0a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:55.147922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761019e9e63a499eb6a4c48fa0213e0a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:55.157995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761019e9e63a499eb6a4c48fa0213e0a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:55.158681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761019e9e63a499eb6a4c48fa0213e0a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:55.159271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63adab26-d17e-400e-a6b9-f4d87356abf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761019e9e63a499eb6a4c48fa0213e0a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:55.182752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 931/1868] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:47:54 2022] DELETE /identity/v3/users/761019e9e63a499eb6a4c48fa0213e0a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:55.188444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:55.189015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:55.189307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:55.215198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b950c-f947-4ddf-89f3-10c1054d4427 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:55.217493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:55.218891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:55.307787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:55.308782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:55.309332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:55.309856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:55.311946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:55.318066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 932/1869] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:55.328024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:55.331439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:55.332766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:55.349115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137d72c-210f-467e-90be-860c9a41ba07 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:55.353933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:55.354671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:55.355687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:55.356167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:55.356628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:55.364971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 938/1870] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:55.369072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:55.397967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:55.408411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 933/1871] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:47:56.031619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.033138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:56.047952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.049299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:56.053546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2920f8-aafb-4564-b182-4526fa8571a4 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.063413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.064435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.064725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.066105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] PATH_INFO: `/v3/projects/20d28e0c22ce471a80ade56e81096634` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.067783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d28e0c22ce471a80ade56e81096634)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.069051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7cfb-418d-4cde-867d-154bb8c7cad3 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.080334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.082341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.082669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.082955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] PATH_INFO: `/v3/projects/8237a4732a5749d6a69d5753eb722198` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.086905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8237a4732a5749d6a69d5753eb722198)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.135232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.149698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.210984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d28e0c22ce471a80ade56e81096634', 'request_id': 'req-f2a88e07-9e88-468d-980b-bb9bea40e2ca'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.219507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d28e0c22ce471a80ade56e81096634', 'request_id': 'req-f2a88e07-9e88-468d-980b-bb9bea40e2ca'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.229781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d28e0c22ce471a80ade56e81096634', 'request_id': 'req-f2a88e07-9e88-468d-980b-bb9bea40e2ca'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.250423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] The token cache is being invalidate because project 20d28e0c22ce471a80ade56e81096634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:56.251095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.251820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f2a88e07-9e88-468d-980b-bb9bea40e2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.253764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 939/1872] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:56 2022] DELETE /identity/v3/projects/20d28e0c22ce471a80ade56e81096634 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:47:56.260023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3190d2-839e-4989-b7f2-fba902d88f98 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.260587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3190d2-839e-4989-b7f2-fba902d88f98 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.262013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3190d2-839e-4989-b7f2-fba902d88f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.279643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8237a4732a5749d6a69d5753eb722198', 'request_id': 'req-cd3df6e1-367d-4628-8549-e11e0c70b9ae'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.292687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8237a4732a5749d6a69d5753eb722198', 'request_id': 'req-cd3df6e1-367d-4628-8549-e11e0c70b9ae'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.307696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8237a4732a5749d6a69d5753eb722198', 'request_id': 'req-cd3df6e1-367d-4628-8549-e11e0c70b9ae'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.315634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cf3190d2-839e-4989-b7f2-fba902d88f98 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:56.319329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cf3190d2-839e-4989-b7f2-fba902d88f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:56.341287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] The token cache is being invalidate because project 8237a4732a5749d6a69d5753eb722198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:47:56.341636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.348211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cd3df6e1-367d-4628-8549-e11e0c70b9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:47:56.350590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 934/1873] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:47:56 2022] DELETE /identity/v3/projects/8237a4732a5749d6a69d5753eb722198 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:56.355398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.355680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.355971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.408708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:56.410035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:56.486627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 940/1874] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:56.496594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a75d65-1646-4ddf-a31e-92e2ea23a18a None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.496887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a75d65-1646-4ddf-a31e-92e2ea23a18a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.500787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a75d65-1646-4ddf-a31e-92e2ea23a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.574026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-03a75d65-1646-4ddf-a31e-92e2ea23a18a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:56.575222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-03a75d65-1646-4ddf-a31e-92e2ea23a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:56.591694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 935/1875] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:56.593247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 941/1876] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:56.599146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.599549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.599846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.600120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.629668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de362a6a-0258-40c1-aedf-4e80a1589841 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.635816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.636624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.636977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.637299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.638718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:56.638718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.643373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:56.644574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:56.665464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 942/1877] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:56.668559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.689244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878665e-ef8a-4a17-9d27-0cf584671815 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.690989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.702465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.703196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.703472 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.703753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.704463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:47:56.704757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.724255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 936/1878] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:56.725062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.731315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.737776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7ac48-2773-471a-a04a-a7ebe4075cd1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.742702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.743336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.743660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.743942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.744571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.746664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 943/1879] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:47:56.750596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.763255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97eeea-11f5-4e1b-9d1c-ce4ca02b1ea6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.768960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.770009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.770510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.771723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.772633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.776317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.804100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.823089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 937/1880] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:56.824175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.851493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 944/1881] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:47:56.861554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:56.910540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126d6d0-9841-43f4-82ca-cf9fe66398cb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.945977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05626520-c228-4138-9676-d5f278b32f02 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:56.950251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.950888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.951174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.951473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.952112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:56.978416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:56.995432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:56.996558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:56.997012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:56.999202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:56.999202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.010858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 945/1882] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:57.011961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:57.021594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81ae89-3144-4c38-a91b-59bb48ef4d45 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:57.025973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.026107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:57.026773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.027062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.027343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.028040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.047847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 938/1883] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:47:56 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:47:57.051549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:57.054418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.061878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5db2-6af9-4aca-a4a1-bf4addb8dada admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:57.066291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 946/1884] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:47:57.068180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:57.070824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:57.071085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.071773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.072202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.073725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.080212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23c504-c35d-455c-b888-ffb919e1eeb9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:57.084483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c4b6e-0646-4de8-a4a8-5a59161c28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:57.085294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4b6e-0646-4de8-a4a8-5a59161c28fc admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.085581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4b6e-0646-4de8-a4a8-5a59161c28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.085860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c4b6e-0646-4de8-a4a8-5a59161c28fc admin admin] PATH_INFO: `/v3/projects/74c5633c05c54190ae1331ab7f1a8db4/users/e5ee4825608b4d10a19fc34199d8dc20/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.107022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c4b6e-0646-4de8-a4a8-5a59161c28fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c5633c05c54190ae1331ab7f1a8db4, user_id=e5ee4825608b4d10a19fc34199d8dc20, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.109937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.122583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 939/1885] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:47:57.125355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:57.135426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c4b6e-0646-4de8-a4a8-5a59161c28fc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.135616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9094b-a9e3-4d2f-b82b-dd0fdbbfa5df admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:57.139956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c6bb3-601c-4bc4-9a6c-5f373b4a9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:57.141007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c6bb3-601c-4bc4-9a6c-5f373b4a9d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.141400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c6bb3-601c-4bc4-9a6c-5f373b4a9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.141693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c6bb3-601c-4bc4-9a6c-5f373b4a9d4b admin admin] PATH_INFO: `/v3/projects/526a4fd4eb634b8f97f20179a31605ba/users/76469d7a75b849bcab25e1f8d2aae8fb/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.152999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 947/1886] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:57 2022] PUT /identity/v3/projects/74c5633c05c54190ae1331ab7f1a8db4/users/e5ee4825608b4d10a19fc34199d8dc20/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:57.163751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.164559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.164559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.173169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c6bb3-601c-4bc4-9a6c-5f373b4a9d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=526a4fd4eb634b8f97f20179a31605ba, user_id=76469d7a75b849bcab25e1f8d2aae8fb, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.202766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c6bb3-601c-4bc4-9a6c-5f373b4a9d4b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.207691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] MFA Rules not processed for user `e5ee4825608b4d10a19fc34199d8dc20`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:57.208868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:57.229539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 940/1887] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:47:57 2022] PUT /identity/v3/projects/526a4fd4eb634b8f97f20179a31605ba/users/76469d7a75b849bcab25e1f8d2aae8fb/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:47:57.231423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.231848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.232219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.282436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] MFA Rules not processed for user `76469d7a75b849bcab25e1f8d2aae8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:47:57.283859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:57.322206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 948/1888] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:57 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:47:57.333072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:57.334501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:57.376890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 941/1889] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:47:57 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:47:57.388057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:47:57.389630 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:47:57.488439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321805-b471-4854-889f-fa1ce077c9d6 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:57.492510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b008bb-e720-4cca-8112-8bbfb473e59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:57.493125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b008bb-e720-4cca-8112-8bbfb473e59d service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.493480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b008bb-e720-4cca-8112-8bbfb473e59d service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.493770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b008bb-e720-4cca-8112-8bbfb473e59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.505705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b008bb-e720-4cca-8112-8bbfb473e59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.530829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea6a55-6c8d-4406-93d9-89dcc139459d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:47:57.534345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:47:57.535098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:47:57.535482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:47:57.535825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b008bb-e720-4cca-8112-8bbfb473e59d service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.536117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:47:57.561058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 942/1890] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:57 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:47:57.633397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:47:57.674326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:47:57.688752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 949/1891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:47:57 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:48:01.744826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35395-75ce-47d6-8472-e9cd9c606ecb None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:01.745590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35395-75ce-47d6-8472-e9cd9c606ecb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:01.745590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35395-75ce-47d6-8472-e9cd9c606ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:01.782010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-e3f35395-75ce-47d6-8472-e9cd9c606ecb None None] MFA Rules not processed for user `45a491cd7bb8422fb6e3ee727d7b15f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:01.783350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e3f35395-75ce-47d6-8472-e9cd9c606ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:01.795369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:01.913876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 943/1892] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:01 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:01.937137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586e8d6-e0c2-4e3c-ad4e-2f55eaabbb3b service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:01.944685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:01.945957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:01.946245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:01.946526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] PATH_INFO: `/v3/users/76469d7a75b849bcab25e1f8d2aae8fb` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:01.947663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76469d7a75b849bcab25e1f8d2aae8fb)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:01.978983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:02.057743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76469d7a75b849bcab25e1f8d2aae8fb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:02.074009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76469d7a75b849bcab25e1f8d2aae8fb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:02.074729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76469d7a75b849bcab25e1f8d2aae8fb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:02.102946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76469d7a75b849bcab25e1f8d2aae8fb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:02.111789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76469d7a75b849bcab25e1f8d2aae8fb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:02.123344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 950/1893] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:01 2022] DELETE /identity/v3/users/76469d7a75b849bcab25e1f8d2aae8fb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:02.127561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:02.128045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:02.128405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:02.157606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:02.158897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:02.256166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 944/1894] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:02.279986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:02.281863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:02.290942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:02.292541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:02.425858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403610b9-83db-43ff-ab60-0561280e50b3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:02.434062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0836e3e-c11a-4670-af88-9c74b467989a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:02.434849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:02.435678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:02.436059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:02.436438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:02.440676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:02.441282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:02.441572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:02.441851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:02.448706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:02.454226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:02.478291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:02.493056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 951/1895] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:02.535261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:02.564294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423593ad-217b-47d8-9b78-972f5e247f83 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:02.576826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 945/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:02 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:48:03.342333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:03.345220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:03.360151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b25a-5e77-4dfc-a3a6-344217a1cc41 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:03.365238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:03.366025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.366288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.366800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] PATH_INFO: `/v3/projects/526a4fd4eb634b8f97f20179a31605ba` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.367973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526a4fd4eb634b8f97f20179a31605ba)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:03.402294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:03.456122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526a4fd4eb634b8f97f20179a31605ba', 'request_id': 'req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:03.461353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526a4fd4eb634b8f97f20179a31605ba', 'request_id': 'req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:03.470918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526a4fd4eb634b8f97f20179a31605ba', 'request_id': 'req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:03.488259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] The token cache is being invalidate because project 526a4fd4eb634b8f97f20179a31605ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:03.488543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:03.489321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67fe3e17-8ebc-4c70-9c25-d9abcd5692b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:03.491100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 952/1897] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:03 2022] DELETE /identity/v3/projects/526a4fd4eb634b8f97f20179a31605ba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:03.496154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.497344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.497898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.527645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:03.528797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:03.604567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 946/1898] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:03.613484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.613781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.614066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.636427 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:03.637606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:03.645650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 953/1899] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:03.650083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:03.659859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd797e9-8ca3-486f-bca0-2b5bf6367c01 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:03.665141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:03.665808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.666138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.666487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.667266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:48:03.667627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:03.693182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:03.706992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 947/1900] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:48:03.711392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:03.723577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44062a1-9571-4fd0-aa89-99cf2d83da85 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:03.731500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:03.732380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.732810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.733202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.734204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:03.759792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:03.791689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 954/1901] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:03 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:03.795984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:03.806486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6df8b-5b24-4792-881a-e67ead479bf9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:03.870738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:03.871336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.871622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.871898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.872521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:03.899165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:03.922522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 948/1902] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:03 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:03.929222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:03.943150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557f0f-97d9-407f-ae93-23b0fefa5872 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:03.950232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a800-7a41-4d0f-84e3-7f917eec5166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:03.951515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a800-7a41-4d0f-84e3-7f917eec5166 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:03.951800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a800-7a41-4d0f-84e3-7f917eec5166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:03.952078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a800-7a41-4d0f-84e3-7f917eec5166 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:03.952886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a800-7a41-4d0f-84e3-7f917eec5166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:03.978664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a800-7a41-4d0f-84e3-7f917eec5166 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:03.989328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 955/1903] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:03.993609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:04.003670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b112d-1276-41fe-becc-98af10eea53e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:04.007932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:04.008706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:04.008988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:04.009270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] PATH_INFO: `/v3/projects/b9c77c708da647a79355697180ce9f3c/users/f6855d3259e84affadba4eb797f0635c/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:04.030578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c77c708da647a79355697180ce9f3c, user_id=f6855d3259e84affadba4eb797f0635c, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:04.057199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:04.071614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 949/1904] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:03 2022] PUT /identity/v3/projects/b9c77c708da647a79355697180ce9f3c/users/f6855d3259e84affadba4eb797f0635c/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:04.081989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:04.082282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:04.082587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:04.120421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] MFA Rules not processed for user `f6855d3259e84affadba4eb797f0635c`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:04.121580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:04.196214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 956/1905] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:04 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:04.208466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:04.210257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:04.289015 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758abf5c-476f-4068-9b72-242bee59e766 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:04.292603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86f071-97bd-46f5-b603-f5fdb8d817bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3caf8a53d924849b5cb756249a1a96f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:04.293215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86f071-97bd-46f5-b603-f5fdb8d817bc service glance] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:04.293469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86f071-97bd-46f5-b603-f5fdb8d817bc service glance] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:04.293773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86f071-97bd-46f5-b603-f5fdb8d817bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:04.304043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86f071-97bd-46f5-b603-f5fdb8d817bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:04.331033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86f071-97bd-46f5-b603-f5fdb8d817bc service glance] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:04.340187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 950/1906] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:04 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:23.428010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:23.429525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:23.505672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b8045-c067-40a6-8576-e0422f502fdb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:23.510351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:23.511186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:23.511478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:23.511756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] PATH_INFO: `/v3/users/3dac764de6054b0faa55cd815d5d8342` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:23.512870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dac764de6054b0faa55cd815d5d8342)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:23.538811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:23.593575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dac764de6054b0faa55cd815d5d8342'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:23.600722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dac764de6054b0faa55cd815d5d8342'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:23.602531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dac764de6054b0faa55cd815d5d8342'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:23.615062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dac764de6054b0faa55cd815d5d8342'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:23.622540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dac764de6054b0faa55cd815d5d8342'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:23.628648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 957/1907] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:23 2022] DELETE /identity/v3/users/3dac764de6054b0faa55cd815d5d8342 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:23.633557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:23.634140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:23.634140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:23.658103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:23.659207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:23.725219 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 951/1908] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:23.736447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:23.737866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:23.804544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16074c51-554e-4bb1-a202-70e3fba60404 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:23.808335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:23.808923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:23.809212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:23.809493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:23.818793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:23.844641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:23.855488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 958/1909] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:24.217084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:24.222011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:24.250831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f995-a9a5-4230-816d-2c601dfafec1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:24.257580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:24.258519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:24.258901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:24.259248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] PATH_INFO: `/v3/projects/01c36d33ee5c468b9bba1828bb84b8e0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:24.260440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c36d33ee5c468b9bba1828bb84b8e0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:24.286123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:24.337986 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c36d33ee5c468b9bba1828bb84b8e0', 'request_id': 'req-2eb71e68-2cb1-4624-901b-95f663297222'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.344162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c36d33ee5c468b9bba1828bb84b8e0', 'request_id': 'req-2eb71e68-2cb1-4624-901b-95f663297222'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.352281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c36d33ee5c468b9bba1828bb84b8e0', 'request_id': 'req-2eb71e68-2cb1-4624-901b-95f663297222'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.375159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] The token cache is being invalidate because project 01c36d33ee5c468b9bba1828bb84b8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:24.375495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.376417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.382295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 952/1910] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:24 2022] DELETE /identity/v3/projects/01c36d33ee5c468b9bba1828bb84b8e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:24.383405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:24.396803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51fe5-01f8-4334-9f4d-7272ff5934f3 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:24.498303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:24.500197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:24.500641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:24.501056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] PATH_INFO: `/v3/users/8376b9f85bae458891b86e3c30e839c8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:24.503381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8376b9f85bae458891b86e3c30e839c8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:24.549317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:24.618884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8376b9f85bae458891b86e3c30e839c8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.628277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8376b9f85bae458891b86e3c30e839c8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.629371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8376b9f85bae458891b86e3c30e839c8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.643430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8376b9f85bae458891b86e3c30e839c8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.651610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-990330fb-9030-460e-9b76-b372c352c0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8376b9f85bae458891b86e3c30e839c8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:24.661266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 959/1911] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:24 2022] DELETE /identity/v3/users/8376b9f85bae458891b86e3c30e839c8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:25.125769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:25.127235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:25.140379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb71e68-2cb1-4624-901b-95f663297222 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:25.206536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:25.207418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.207706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.207991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] PATH_INFO: `/v3/projects/82941761c8324572a8d0445b00806825` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.209096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82941761c8324572a8d0445b00806825)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:25.234447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:25.292925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82941761c8324572a8d0445b00806825', 'request_id': 'req-8fa64de6-f868-4a38-a3c2-2dd01250f509'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:25.298149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82941761c8324572a8d0445b00806825', 'request_id': 'req-8fa64de6-f868-4a38-a3c2-2dd01250f509'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:25.307520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82941761c8324572a8d0445b00806825', 'request_id': 'req-8fa64de6-f868-4a38-a3c2-2dd01250f509'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:25.324847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] The token cache is being invalidate because project 82941761c8324572a8d0445b00806825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:25.325138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:25.325848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8fa64de6-f868-4a38-a3c2-2dd01250f509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:25.327457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 953/1912] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:25 2022] DELETE /identity/v3/projects/82941761c8324572a8d0445b00806825 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:25.334027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c192f4-a887-451a-90eb-803878fed270 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.334816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c192f4-a887-451a-90eb-803878fed270 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.334816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c192f4-a887-451a-90eb-803878fed270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.359853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-21c192f4-a887-451a-90eb-803878fed270 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:25.361463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-21c192f4-a887-451a-90eb-803878fed270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:25.436665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 960/1913] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:25.447176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.447460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.447752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.471795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:25.472860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:25.480946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 954/1914] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:25.485567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c192f4-a887-451a-90eb-803878fed270 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:25.496482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c192f4-a887-451a-90eb-803878fed270 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:25.501824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:25.502743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.503031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.503314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.504020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:48:25.504313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:25.530849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:25.546240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 961/1915] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:48:25.551509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:25.560421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c5350-608b-40bb-bc1e-923afb0465ab None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:25.565988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:25.566800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.567159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.567519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.568268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:25.602538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:25.633268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 955/1916] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:25 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:25.637801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:25.647667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9962cc-a95f-496f-977f-fb442249b6a0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:25.737232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:25.738036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.738372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.738682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.739782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:25.770905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:25.794019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 962/1917] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:25 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:25.797770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:25.809665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222dc3ee-a280-4d34-826f-3d2dadca1228 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:25.815031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6faa0-3312-4586-aa4e-e45c10e3f534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:25.815761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6faa0-3312-4586-aa4e-e45c10e3f534 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.816124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6faa0-3312-4586-aa4e-e45c10e3f534 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.816609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6faa0-3312-4586-aa4e-e45c10e3f534 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.817374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6faa0-3312-4586-aa4e-e45c10e3f534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:25.847301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6faa0-3312-4586-aa4e-e45c10e3f534 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:25.858928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 956/1918] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:48:25.865060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:25.876628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18573-2857-44f3-adb0-c64ed638cf96 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:25.886707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:25.887812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.888194 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.888576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] PATH_INFO: `/v3/projects/2442120e5eeb4a6aa005ddab94f07dcc/users/28bc95c2b08344bc800224869bf2c0ef/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:25.910189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2442120e5eeb4a6aa005ddab94f07dcc, user_id=28bc95c2b08344bc800224869bf2c0ef, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:25.937494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:25.956461 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 963/1919] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:25 2022] PUT /identity/v3/projects/2442120e5eeb4a6aa005ddab94f07dcc/users/28bc95c2b08344bc800224869bf2c0ef/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:25.972177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:25.972537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:25.972755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.012459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] MFA Rules not processed for user `28bc95c2b08344bc800224869bf2c0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:26.013775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:26.179086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 957/1920] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:25 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:26.184060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.259301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94296f4-9864-4332-9db6-429a23971436 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.263491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.264081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.264363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.264639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.265267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.299005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.332204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 964/1921] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:26 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:26.336691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.348169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128badd4-c109-4df2-ab5a-0b9fe7e9248b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.411881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.412631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.413032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.413316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.413951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.440039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.465149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 958/1922] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:26 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:26.469196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.479676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726026dc-4948-4eea-afd1-3ea607cc5191 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.485184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.485805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.486100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.486487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.487222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.512768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.525385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 965/1923] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:26.530115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.539737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f984c6-17b2-4265-96a3-69e67efc0165 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.544548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.545346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.545690 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.545920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] PATH_INFO: `/v3/projects/45dfba40dc1c42f992b67b5840e505aa/users/7169ae11c6574c85bdb7bdc6846ec5b0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.567000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dfba40dc1c42f992b67b5840e505aa, user_id=7169ae11c6574c85bdb7bdc6846ec5b0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.595265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.612012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 959/1924] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:26 2022] PUT /identity/v3/projects/45dfba40dc1c42f992b67b5840e505aa/users/7169ae11c6574c85bdb7bdc6846ec5b0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:26.615723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.625568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7416b-cd06-4430-980e-bf85760bc648 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.689304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.690338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.690648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.690939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.691632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.717709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.728987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 966/1925] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:26.733684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.745407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d9ca-4f8f-4776-a7ce-d15e47b3ffd2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.750509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.751406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.751707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.752006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] PATH_INFO: `/v3/projects/45dfba40dc1c42f992b67b5840e505aa/users/7169ae11c6574c85bdb7bdc6846ec5b0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.754047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dfba40dc1c42f992b67b5840e505aa, user_id=7169ae11c6574c85bdb7bdc6846ec5b0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.781642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.794251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 960/1926] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:26 2022] PUT /identity/v3/projects/45dfba40dc1c42f992b67b5840e505aa/users/7169ae11c6574c85bdb7bdc6846ec5b0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:26.797616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.807453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752b74-36b7-4c65-890c-7474ae1af4e4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.873929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654de258-5950-4635-9f2a-61619707c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.874750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654de258-5950-4635-9f2a-61619707c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.875103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654de258-5950-4635-9f2a-61619707c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.876346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654de258-5950-4635-9f2a-61619707c4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.877090 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654de258-5950-4635-9f2a-61619707c4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.907335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654de258-5950-4635-9f2a-61619707c4ea admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.919473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 967/1927] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:26.923774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:26.934124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942aa58-6830-4140-ada7-39d4a0b2da42 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:26.938714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:26.939568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.939918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.940226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] PATH_INFO: `/v3/projects/45dfba40dc1c42f992b67b5840e505aa/users/7169ae11c6574c85bdb7bdc6846ec5b0/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:26.942036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dfba40dc1c42f992b67b5840e505aa, user_id=7169ae11c6574c85bdb7bdc6846ec5b0, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:26.969716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:26.986286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 961/1928] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:26 2022] PUT /identity/v3/projects/45dfba40dc1c42f992b67b5840e505aa/users/7169ae11c6574c85bdb7bdc6846ec5b0/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:26.995947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:26.996246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:26.996529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:27.033615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] MFA Rules not processed for user `7169ae11c6574c85bdb7bdc6846ec5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:27.034902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:27.120996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 968/1929] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:26 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:27.133175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:27.135866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:27.206362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea91a97-afbd-4387-a52c-d333eebd8312 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:27.209998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc849e25-a1ac-4aa7-bf00-c63cc162d616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:27.210696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849e25-a1ac-4aa7-bf00-c63cc162d616 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:27.211056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849e25-a1ac-4aa7-bf00-c63cc162d616 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:27.211410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc849e25-a1ac-4aa7-bf00-c63cc162d616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:27.278251 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc849e25-a1ac-4aa7-bf00-c63cc162d616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:27.304951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc849e25-a1ac-4aa7-bf00-c63cc162d616 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:27.316215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 962/1930] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:27 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:48:28.016223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:28.018436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:28.095904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdab038-1dbe-467b-a338-9d745253cea9 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:28.101199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:28.102178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:28.102444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:28.102752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] PATH_INFO: `/v3/users/e5ee4825608b4d10a19fc34199d8dc20` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:28.103982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ee4825608b4d10a19fc34199d8dc20)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:28.129768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:28.188466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ee4825608b4d10a19fc34199d8dc20'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:28.198702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ee4825608b4d10a19fc34199d8dc20'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:28.199452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ee4825608b4d10a19fc34199d8dc20'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:28.216963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ee4825608b4d10a19fc34199d8dc20'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:28.232391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ee4825608b4d10a19fc34199d8dc20'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:28.250723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 969/1931] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:28 2022] DELETE /identity/v3/users/e5ee4825608b4d10a19fc34199d8dc20 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:28.253609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:28.254039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:28.254201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:28.288532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:28.290051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:28.381591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 963/1932] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:28.439009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:28.441721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:28.527504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dda84d-0eef-4f0d-88f3-a71f27c4ec0e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:28.531328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec994-33f7-4d94-adeb-2305762d60cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:28.531917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec994-33f7-4d94-adeb-2305762d60cc service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:28.532337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec994-33f7-4d94-adeb-2305762d60cc service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:28.532624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec994-33f7-4d94-adeb-2305762d60cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:28.550983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ec994-33f7-4d94-adeb-2305762d60cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:28.577748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ec994-33f7-4d94-adeb-2305762d60cc service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:28.592242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 970/1933] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:48:29.775267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:29.776603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:29.788920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eb20d-06a2-4d2b-988d-08be54297249 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:29.793246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:29.800435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:29.800725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:29.801004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] PATH_INFO: `/v3/projects/74c5633c05c54190ae1331ab7f1a8db4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:29.802189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c5633c05c54190ae1331ab7f1a8db4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:29.829084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:29.898259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c5633c05c54190ae1331ab7f1a8db4', 'request_id': 'req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:29.911454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c5633c05c54190ae1331ab7f1a8db4', 'request_id': 'req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:29.924112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c5633c05c54190ae1331ab7f1a8db4', 'request_id': 'req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:29.943787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] The token cache is being invalidate because project 74c5633c05c54190ae1331ab7f1a8db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:29.944528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:29.945283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e4cd7316-b14f-4d9e-9026-37ed3db22eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:29.947898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 964/1934] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:29 2022] DELETE /identity/v3/projects/74c5633c05c54190ae1331ab7f1a8db4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:29.952395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:29.952896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:29.952970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:29.977345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:29.978500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.065807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 971/1935] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:30.074698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.075000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.075273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.097903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:30.099257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.106835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 965/1936] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:30.111446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.121050 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e7d4a-a89d-4574-bb9c-a717670da9d4 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.128596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.129372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.129731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.130103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.130965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:48:30.131324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.158258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.171423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 972/1937] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:48:30.175969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.185036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13be41-dcac-4e36-a9e6-9d2610f310a6 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.189815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.190406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.190733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.191014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.191650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.217317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.253528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 966/1938] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:30 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:30.257744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.267576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ef14a-c53b-4935-9594-1d371372e351 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.286322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.289600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.338882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.339563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.339847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.340132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.340824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.367179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.374457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f8940-a2d7-484a-8659-bc5585c1287e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.379842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.380738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.381054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.381459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] PATH_INFO: `/v3/users/28bc95c2b08344bc800224869bf2c0ef` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.382785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bc95c2b08344bc800224869bf2c0ef)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.388794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 973/1939] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:30 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:30.392704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.401940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df12ea2-5ac2-4150-9dde-6d2e18066d75 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.406707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.407599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.408023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.408512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.409551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.411774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.436331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.450599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 974/1940] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:48:30.453174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.462984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57de55e-5668-488c-88ec-23cd0bfa877b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.467109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6841e-c439-4a3a-bf97-9d5c46f3ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.467997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6841e-c439-4a3a-bf97-9d5c46f3ce9b admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.468276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6841e-c439-4a3a-bf97-9d5c46f3ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.468556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6841e-c439-4a3a-bf97-9d5c46f3ce9b admin admin] PATH_INFO: `/v3/projects/df6310ee4c214b53bfc3fa13d6f15b83/users/fa4639aff93a476ea70ba053c8bad1cb/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.472549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bc95c2b08344bc800224869bf2c0ef'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:30.480808 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bc95c2b08344bc800224869bf2c0ef'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:30.488561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bc95c2b08344bc800224869bf2c0ef'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:30.489046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6841e-c439-4a3a-bf97-9d5c46f3ce9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6310ee4c214b53bfc3fa13d6f15b83, user_id=fa4639aff93a476ea70ba053c8bad1cb, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.489179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bc95c2b08344bc800224869bf2c0ef'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:30.489773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ec913eab-4e83-4edc-b3c5-3dfc98b60df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bc95c2b08344bc800224869bf2c0ef'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:30.512223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 967/1941] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:30 2022] DELETE /identity/v3/users/28bc95c2b08344bc800224869bf2c0ef => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:30.518007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6841e-c439-4a3a-bf97-9d5c46f3ce9b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.519074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.519382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.519653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.532981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 975/1942] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:30 2022] PUT /identity/v3/projects/df6310ee4c214b53bfc3fa13d6f15b83/users/fa4639aff93a476ea70ba053c8bad1cb/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:30.537512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.537806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.538089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.541627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:30.542788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.559453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:30.560561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.606992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 968/1943] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:30.618156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.619457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.626689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 976/1944] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:30.637758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:30.639304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:30.688053 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda56a-296e-4b47-bdca-55580e36f0d3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.692432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.693024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.693307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.693580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.703604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.705302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d989a0-2515-40d0-bba4-e2f43f2c84ec None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:30.708829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:30.709411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:30.709695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:30.709970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:30.718830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:30.729948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.740854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 969/1945] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:48:30.743862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:30.754296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 977/1946] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:31.123101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:31.135539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:31.152531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477f76e-641d-419d-9958-d48a547253f8 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:31.160048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:31.161649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:31.162540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:31.163191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] PATH_INFO: `/v3/projects/2442120e5eeb4a6aa005ddab94f07dcc` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:31.164510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2442120e5eeb4a6aa005ddab94f07dcc)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:31.211101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:31.301077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2442120e5eeb4a6aa005ddab94f07dcc', 'request_id': 'req-4954a8d4-46f7-454f-8321-ccc7dbed08b5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.311138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2442120e5eeb4a6aa005ddab94f07dcc', 'request_id': 'req-4954a8d4-46f7-454f-8321-ccc7dbed08b5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.322545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2442120e5eeb4a6aa005ddab94f07dcc', 'request_id': 'req-4954a8d4-46f7-454f-8321-ccc7dbed08b5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.341809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] The token cache is being invalidate because project 2442120e5eeb4a6aa005ddab94f07dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:31.342216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.343096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.348129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 970/1947] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:31 2022] DELETE /identity/v3/projects/2442120e5eeb4a6aa005ddab94f07dcc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:31.349093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:31.359227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7792c-9b01-479f-987f-1d952155a9aa service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:31.436705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:31.437849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:31.438395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:31.438713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] PATH_INFO: `/v3/users/7169ae11c6574c85bdb7bdc6846ec5b0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:31.441209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7169ae11c6574c85bdb7bdc6846ec5b0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:31.473340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:31.526248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7169ae11c6574c85bdb7bdc6846ec5b0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.533590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7169ae11c6574c85bdb7bdc6846ec5b0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.534211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7169ae11c6574c85bdb7bdc6846ec5b0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.547415 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7169ae11c6574c85bdb7bdc6846ec5b0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.555126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cdabd2a4-eb8f-4042-9320-a1c9250c26a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7169ae11c6574c85bdb7bdc6846ec5b0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:31.561122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 978/1948] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:31 2022] DELETE /identity/v3/users/7169ae11c6574c85bdb7bdc6846ec5b0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:32.057658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:32.059817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:32.083000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954a8d4-46f7-454f-8321-ccc7dbed08b5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:32.149300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:32.151158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.151675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.152119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] PATH_INFO: `/v3/projects/45dfba40dc1c42f992b67b5840e505aa` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.153378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45dfba40dc1c42f992b67b5840e505aa)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:32.193039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:32.292520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dfba40dc1c42f992b67b5840e505aa', 'request_id': 'req-23e7d97d-796d-4d27-a4dd-40cbfab2506f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:32.300764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dfba40dc1c42f992b67b5840e505aa', 'request_id': 'req-23e7d97d-796d-4d27-a4dd-40cbfab2506f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:32.311827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dfba40dc1c42f992b67b5840e505aa', 'request_id': 'req-23e7d97d-796d-4d27-a4dd-40cbfab2506f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:32.342350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] The token cache is being invalidate because project 45dfba40dc1c42f992b67b5840e505aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:32.342907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:32.343727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-23e7d97d-796d-4d27-a4dd-40cbfab2506f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:32.346773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 971/1949] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:32 2022] DELETE /identity/v3/projects/45dfba40dc1c42f992b67b5840e505aa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:32.351712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.352112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.352273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.377595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:32.378821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:32.499547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 979/1950] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:32.508896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.509028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.509280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.544907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:32.546252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:32.556411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 972/1951] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:32.560391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:32.576253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac64530-9c21-4c7a-9f11-0283898bc1ae None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:32.580827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:32.581610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.582086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.582523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.583408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:48:32.584457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:32.611188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:32.625305 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 980/1952] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:48:32.629701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:32.639371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd80ec2-c1b6-4ae7-9020-f1b103d90c1a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:32.644383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:32.645002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.645282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.645697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.646373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:32.673729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:32.715517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 973/1953] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:32 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:32.716726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:32.729403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1a7a7-f89e-45c8-bbe0-4972fbe42aa2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:32.831931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:32.832859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.833481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.833956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.835218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:32.869325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:32.898919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 981/1954] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:32 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:32.903205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:32.916966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d312-6857-4905-a803-666258f5a3dd admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:32.922800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa39baa-e8e6-486b-b484-a0d69fbf6985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:32.924258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa39baa-e8e6-486b-b484-a0d69fbf6985 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:32.924623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa39baa-e8e6-486b-b484-a0d69fbf6985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:32.925054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa39baa-e8e6-486b-b484-a0d69fbf6985 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:32.925777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa39baa-e8e6-486b-b484-a0d69fbf6985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:32.961632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa39baa-e8e6-486b-b484-a0d69fbf6985 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:32.976181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 974/1955] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:48:32.980444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:32.996114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a80d23-9e91-46ba-933f-c7a823943415 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:33.016683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:33.017724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.018037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.020225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] PATH_INFO: `/v3/projects/5aaa651ef1034ff49a9e2f70654dd85c/users/50534cf3a1494b148d51b248e3960dc7/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.063899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aaa651ef1034ff49a9e2f70654dd85c, user_id=50534cf3a1494b148d51b248e3960dc7, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:33.090292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:33.118586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 982/1956] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:32 2022] PUT /identity/v3/projects/5aaa651ef1034ff49a9e2f70654dd85c/users/50534cf3a1494b148d51b248e3960dc7/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:33.120011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.120311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.120729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.169225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] MFA Rules not processed for user `50534cf3a1494b148d51b248e3960dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:33.170734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:33.298970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 975/1957] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:33.305116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:33.383366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb283007-e260-4201-874d-bc3df7a65b6a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:33.388136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:33.388832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.389214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.389590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.390341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:33.420478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:33.473199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:33.489114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 983/1958] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:33.492040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fed41-1312-4014-b43a-cf1946f688d1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:33.571853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:33.572742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.573263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.573819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.574782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:33.615368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:33.641452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 976/1959] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:33 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:33.645863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:33.658676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074eeda-c518-40e3-956c-b468052a4616 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:33.680642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb0aeb-d52d-48e3-93a5-e363316a932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:33.681334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0aeb-d52d-48e3-93a5-e363316a932a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.681729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0aeb-d52d-48e3-93a5-e363316a932a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.682325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb0aeb-d52d-48e3-93a5-e363316a932a admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.683077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb0aeb-d52d-48e3-93a5-e363316a932a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:33.713107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb0aeb-d52d-48e3-93a5-e363316a932a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:33.740701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 984/1960] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:48:33.741904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:33.753846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be82aa-f5f9-4f92-ac4a-32bb4a788349 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:33.759536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:33.760524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.760982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.761197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] PATH_INFO: `/v3/projects/01312c945ac04dd3911bd238341927a0/users/cae9f668f70f4922a49fcd08c8a7d05d/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.800626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01312c945ac04dd3911bd238341927a0, user_id=cae9f668f70f4922a49fcd08c8a7d05d, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:33.845593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:33.875356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 977/1961] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:33 2022] PUT /identity/v3/projects/01312c945ac04dd3911bd238341927a0/users/cae9f668f70f4922a49fcd08c8a7d05d/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:33.888552 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:33.888846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:33.889255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:33.942894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] MFA Rules not processed for user `cae9f668f70f4922a49fcd08c8a7d05d`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:33.944423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:34.016548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 985/1962] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:33 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:34.021654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.105583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f60c13-8553-4f2e-87e8-4480cedb1070 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:34.110624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:34.111377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:34.111983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:34.111983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:34.112818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:34.147965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:34.195853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 978/1963] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:34 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:34.197122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.217034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c17496-fd39-4627-89ce-f3231c53fb96 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:34.341874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:34.343944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:34.344519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:34.344897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:34.345724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:34.372676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:34.410658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 986/1964] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:34 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:34.415155 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.445632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647c163-ce34-4fe5-9193-807810e8d798 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:34.462266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:34.463300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:34.463738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:34.464265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:34.465183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:34.520671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:34.537143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 979/1965] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:34.540776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.550584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1fdb-702c-45a7-86f4-71cc8dee6e8f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:34.555312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:34.556307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:34.556740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:34.557184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] PATH_INFO: `/v3/projects/045b826914e745aab05f6874b8b121d4/users/b45033cb9b4d4e27b17573658d813133/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:34.583037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045b826914e745aab05f6874b8b121d4, user_id=b45033cb9b4d4e27b17573658d813133, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:34.620104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:34.643973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 987/1966] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:34 2022] PUT /identity/v3/projects/045b826914e745aab05f6874b8b121d4/users/b45033cb9b4d4e27b17573658d813133/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:34.648635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.661509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72466f15-4faa-4540-a081-1ca8b5d4c0d6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:34.751392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:34.752148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:34.752537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:34.752991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:34.754068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:34.789506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:34.809766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 980/1967] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:34.813536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.826463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8102711-6183-44fa-a007-75f12429f260 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:34.840487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:34.841588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:34.842021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:34.842474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] PATH_INFO: `/v3/projects/045b826914e745aab05f6874b8b121d4/users/b45033cb9b4d4e27b17573658d813133/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:34.847061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045b826914e745aab05f6874b8b121d4, user_id=b45033cb9b4d4e27b17573658d813133, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:34.913705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:34.945126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 988/1968] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:34 2022] PUT /identity/v3/projects/045b826914e745aab05f6874b8b121d4/users/b45033cb9b4d4e27b17573658d813133/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:34.946160 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:34.956999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195ec33-4f78-4805-9c1b-a2f8657c6b8c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:35.091275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05d3c-3c50-4853-8905-0addf57ad66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:35.091905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05d3c-3c50-4853-8905-0addf57ad66b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:35.092204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05d3c-3c50-4853-8905-0addf57ad66b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:35.092474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05d3c-3c50-4853-8905-0addf57ad66b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:35.093182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa05d3c-3c50-4853-8905-0addf57ad66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:35.144437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa05d3c-3c50-4853-8905-0addf57ad66b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:35.174114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 981/1969] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:35.178467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:35.190242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4638-44ae-4df2-8241-4c09d8b76a77 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:35.197542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:35.198383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:35.198728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:35.199010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] PATH_INFO: `/v3/projects/045b826914e745aab05f6874b8b121d4/users/b45033cb9b4d4e27b17573658d813133/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:35.200874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045b826914e745aab05f6874b8b121d4, user_id=b45033cb9b4d4e27b17573658d813133, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:35.257470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:35.296512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 989/1970] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:35 2022] PUT /identity/v3/projects/045b826914e745aab05f6874b8b121d4/users/b45033cb9b4d4e27b17573658d813133/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:35.298347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb719bf-c691-4074-adb1-6c3974b753be None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:35.298885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb719bf-c691-4074-adb1-6c3974b753be None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:35.299180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb719bf-c691-4074-adb1-6c3974b753be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:35.348864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2cb719bf-c691-4074-adb1-6c3974b753be None None] MFA Rules not processed for user `b45033cb9b4d4e27b17573658d813133`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:35.349563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2cb719bf-c691-4074-adb1-6c3974b753be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:35.531921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 982/1971] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:35 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:35.543656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:35.546100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:35.629410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44c462-738b-4d18-aeff-f11222691197 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:35.632847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:35.633565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:35.633856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:35.634139 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:35.747410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:35.779751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:35.803178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 990/1972] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:35 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:36.331158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:36.331701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:36.331701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:36.354139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] MFA Rules not processed for user `45a491cd7bb8422fb6e3ee727d7b15f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:36.355594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:36.427011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 983/1973] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:36 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:36.699971 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:36.701350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:36.809542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22d560-c5c0-4f05-a047-f9be1742a2a0 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:36.814220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:36.815400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:36.815698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:36.815983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] PATH_INFO: `/v3/users/257daff704df4c1a950ecf9008d0f224` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:36.827737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] RBAC: Authorizing `identity:delete_user(user_id=257daff704df4c1a950ecf9008d0f224)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:36.880851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:36.996897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257daff704df4c1a950ecf9008d0f224'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.011814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257daff704df4c1a950ecf9008d0f224'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.012610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257daff704df4c1a950ecf9008d0f224'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.028531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257daff704df4c1a950ecf9008d0f224'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.055248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-62fa116f-d242-4d7f-88c5-008e5825618e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257daff704df4c1a950ecf9008d0f224'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.063921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 991/1974] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:36 2022] DELETE /identity/v3/users/257daff704df4c1a950ecf9008d0f224 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:37.480423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:37.530349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964c81b-98b2-440c-a0e2-881e5b90b69b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:37.640629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:37.641490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:37.641839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:37.641839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] PATH_INFO: `/v3/projects/257851b949234252b54d9524d8ffca6d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:37.643365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=257851b949234252b54d9524d8ffca6d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:37.683674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:37.761789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257851b949234252b54d9524d8ffca6d', 'request_id': 'req-0c6c8626-5b45-4158-be16-69a76a4ad54d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.770783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257851b949234252b54d9524d8ffca6d', 'request_id': 'req-0c6c8626-5b45-4158-be16-69a76a4ad54d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.781268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257851b949234252b54d9524d8ffca6d', 'request_id': 'req-0c6c8626-5b45-4158-be16-69a76a4ad54d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.825462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] The token cache is being invalidate because project 257851b949234252b54d9524d8ffca6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:37.825752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.826470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0c6c8626-5b45-4158-be16-69a76a4ad54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:37.828388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 984/1975] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:37 2022] DELETE /identity/v3/projects/257851b949234252b54d9524d8ffca6d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:37.833343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:37.833769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:37.833939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:37.874024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:37.875216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.086012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 992/1976] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:38.095493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.096021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.096547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.153139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:38.154381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.172064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.189230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4bd61-cbe4-4223-a685-35d8bb54a47b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.190214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 985/1977] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:38.200515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.201143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.201432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.201946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.202835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:48:38.203289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:38.258872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:38.273857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 993/1978] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:48:38.277889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.293318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49311401-e3f3-4336-8035-04f35785dfe3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.298992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.299892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.300419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.300908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.301764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:38.333311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:38.373534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 986/1979] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:38 2022] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:38.374834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.386418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c2e0c-08dc-4d97-a5ab-420f58926fe1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.465917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.466748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.467030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.467317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.468179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:38.500760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:38.524871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 994/1980] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:38 2022] POST /identity/v3/users => generated 279 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:38.529094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.547478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f77c19-7dea-4874-b2f0-5c24777247d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.552141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eb045-859a-48d8-9e85-ec77efaa821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.552775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eb045-859a-48d8-9e85-ec77efaa821c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.553063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eb045-859a-48d8-9e85-ec77efaa821c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.553346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eb045-859a-48d8-9e85-ec77efaa821c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.554046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eb045-859a-48d8-9e85-ec77efaa821c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:38.580887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eb045-859a-48d8-9e85-ec77efaa821c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:38.592389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 987/1981] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:38.597027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.607287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad805e3-e417-4e4f-97ad-c56c0d10b585 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.612727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23436b1d-5364-4504-b237-972ade0a03fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.613743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436b1d-5364-4504-b237-972ade0a03fd admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.614041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436b1d-5364-4504-b237-972ade0a03fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.614366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436b1d-5364-4504-b237-972ade0a03fd admin admin] PATH_INFO: `/v3/projects/ad95e0b3375849de882cf4dcb62d212e/users/8389c83df3694d1cb1318e2a37fc1fdb/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.644469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23436b1d-5364-4504-b237-972ade0a03fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad95e0b3375849de882cf4dcb62d212e, user_id=8389c83df3694d1cb1318e2a37fc1fdb, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:38.675663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23436b1d-5364-4504-b237-972ade0a03fd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:38.701254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 995/1982] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:38 2022] PUT /identity/v3/projects/ad95e0b3375849de882cf4dcb62d212e/users/8389c83df3694d1cb1318e2a37fc1fdb/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:38.705009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.705260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.705529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.705812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.706224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.706736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.749151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] MFA Rules not processed for user `fa4639aff93a476ea70ba053c8bad1cb`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:38.750308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.769904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] MFA Rules not processed for user `8389c83df3694d1cb1318e2a37fc1fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:38.771438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.841271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 996/1983] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:38 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:38.845297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.846522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.863490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 988/1984] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:38 2022] POST /identity/v3/auth/tokens => generated 3664 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:38.863490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:38.865468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.934038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2cb56-02bf-4188-a7ed-ea5a1191a9c2 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.940849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.942002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.942595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.942805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03981c2-b3fc-4d77-b737-dd4fcbeb16c5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:38.943331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.946976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:38.966907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:38.967593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:38.967905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:38.968171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:38.968813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.027145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.056983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.082978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 989/1985] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:38 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:39.082978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.108630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.126884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 997/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:38 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:39.128391 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.149032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451928-76f6-4e2d-9d9d-bac9402bd11d service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.220841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28f655-598c-427c-8c95-1b6e922c714f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.229351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.231968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.232382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.232738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.233620 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.258298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.259034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.259393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.259741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.260459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.284893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.309824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.334014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 990/1987] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:39 2022] POST /identity/v3/projects => generated 357 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:39.336048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.336588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 998/1988] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:39 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:39.337835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.349388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2629cfa-3f56-43e7-b77f-3441028739f0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.420561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.420561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.420561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.420561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.421496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.449318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.450858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fe7e4-6b5b-49b5-a881-f8645a2fa3c9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.457399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.458117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.458411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.459023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.459724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.463861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 999/1989] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:39.468139 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.481548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc7a47-0a68-4987-ad46-f8505f558555 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.487582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.488731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.489110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.489489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] PATH_INFO: `/v3/projects/db398b9d5dbe4cda9280752fbebbddaf/users/b9ebef92ee034ac788278db5e75054d0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.491581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.513960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db398b9d5dbe4cda9280752fbebbddaf, user_id=b9ebef92ee034ac788278db5e75054d0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.517164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 991/1990] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:39 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:39.521342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.537279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5218-d928-49e3-9457-b8253cf23dab admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.546392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.549412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.549828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.550208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.551388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.552684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.575828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1000/1991] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:39 2022] PUT /identity/v3/projects/db398b9d5dbe4cda9280752fbebbddaf/users/b9ebef92ee034ac788278db5e75054d0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:39.576928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.589670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.604879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 992/1992] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:48:39.608913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.624471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841694-90f6-4c0c-9776-b0188f8804f3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.719611 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3de2c-6c13-4635-b734-fd33eecaf439 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.725125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.725314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.725736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.725969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.726069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.726294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.726461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.726781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] PATH_INFO: `/v3/projects/1630ffbdb992482cb95e779f0f616c0a/users/27da2efdca284426bdc4bd393e506d0a/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.727043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.754050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1630ffbdb992482cb95e779f0f616c0a, user_id=27da2efdca284426bdc4bd393e506d0a, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.756836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.774029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1001/1993] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:39.775165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.788011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af7c1-6ff6-4c74-8461-8fe1474aea3c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.811977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:39.815788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:39.817448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:39.817914 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] PATH_INFO: `/v3/projects/db398b9d5dbe4cda9280752fbebbddaf/users/b9ebef92ee034ac788278db5e75054d0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:39.822329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.823214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db398b9d5dbe4cda9280752fbebbddaf, user_id=b9ebef92ee034ac788278db5e75054d0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:39.854638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 993/1994] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:39 2022] PUT /identity/v3/projects/1630ffbdb992482cb95e779f0f616c0a/users/27da2efdca284426bdc4bd393e506d0a/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:39.856435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.891030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:39.903062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1002/1995] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:39 2022] PUT /identity/v3/projects/db398b9d5dbe4cda9280752fbebbddaf/users/b9ebef92ee034ac788278db5e75054d0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:39.906498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:39.957574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3eede-9a9f-4fa9-9818-9f258bcf356a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:39.995618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ea368-f544-47f1-853d-5ecbf80815d0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.003132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.003673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.003963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.004244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.004956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.037099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.037810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.038182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.038448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.039225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.058444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.067110 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.079873 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 994/1996] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:40.083747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1003/1997] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:48:40.084667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:40.084880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:40.097335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0c7b8-ad04-4616-89c9-a87f57e40311 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.108745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2365a-a18b-42ce-bd7f-b4ad502f7f1b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.116874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.117865 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.118208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.118578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] PATH_INFO: `/v3/projects/db398b9d5dbe4cda9280752fbebbddaf/users/b9ebef92ee034ac788278db5e75054d0/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.120625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=db398b9d5dbe4cda9280752fbebbddaf, user_id=b9ebef92ee034ac788278db5e75054d0, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.120945 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.122141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.122432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.122743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] PATH_INFO: `/v3/projects/1630ffbdb992482cb95e779f0f616c0a/users/27da2efdca284426bdc4bd393e506d0a/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.126052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1630ffbdb992482cb95e779f0f616c0a, user_id=27da2efdca284426bdc4bd393e506d0a, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.166186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.172073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.185817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 995/1998] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:40 2022] PUT /identity/v3/projects/1630ffbdb992482cb95e779f0f616c0a/users/27da2efdca284426bdc4bd393e506d0a/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:40.187555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1004/1999] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:40 2022] PUT /identity/v3/projects/db398b9d5dbe4cda9280752fbebbddaf/users/b9ebef92ee034ac788278db5e75054d0/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:40.188330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:40.302095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7571-2978-44dd-98a1-f259c5249233 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.314058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.315316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.315644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.316075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.317414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.349297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.362112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 996/2000] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:40.367682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:40.383810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:40.385713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:40.477284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28182e7-594f-4c7e-b11f-0df394dc6342 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.480921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.482010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.482457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.482905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.486950 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:40.528714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d54b7-b146-4f14-989f-430e68b368fa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.535390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27281e40-c83b-401d-8ccb-3caf3dce9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.536706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281e40-c83b-401d-8ccb-3caf3dce9c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.537602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281e40-c83b-401d-8ccb-3caf3dce9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.538221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27281e40-c83b-401d-8ccb-3caf3dce9c75 admin admin] PATH_INFO: `/v3/projects/1630ffbdb992482cb95e779f0f616c0a/users/27da2efdca284426bdc4bd393e506d0a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.541095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27281e40-c83b-401d-8ccb-3caf3dce9c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1630ffbdb992482cb95e779f0f616c0a, user_id=27da2efdca284426bdc4bd393e506d0a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.571614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27281e40-c83b-401d-8ccb-3caf3dce9c75 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.590086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.597393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1005/2001] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:40 2022] PUT /identity/v3/projects/1630ffbdb992482cb95e779f0f616c0a/users/27da2efdca284426bdc4bd393e506d0a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:40.618714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.619067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.619362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.622770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.647260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 997/2002] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:40 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:40.663197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] MFA Rules not processed for user `27da2efdca284426bdc4bd393e506d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:40.664455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:40.796706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1006/2003] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3731 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:40.803608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:40.812031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92229b75-1ec9-4c74-a9b1-3ff6a3727948 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:40.892872 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:40.893788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:40.894291 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:40.895000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:40.906025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:40.948709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:40.963513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 998/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:40 2022] GET /identity/v3/auth/tokens => generated 3731 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:41.100644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:41.112963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e290f3-b5b0-400c-817f-8fc9b61a0556 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:41.119483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8402b-22f9-4d74-b233-c6e2fe78ba6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:41.120961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8402b-22f9-4d74-b233-c6e2fe78ba6b service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:41.121438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8402b-22f9-4d74-b233-c6e2fe78ba6b service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:41.121873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8402b-22f9-4d74-b233-c6e2fe78ba6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:41.250904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8402b-22f9-4d74-b233-c6e2fe78ba6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:41.312553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8402b-22f9-4d74-b233-c6e2fe78ba6b service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:41.337758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1007/2005] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:41 2022] GET /identity/v3/auth/tokens => generated 3664 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:45.440191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:45.442112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:45.604034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8d93f-3ba0-4a11-b78c-7554aaf68057 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:45.620101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:45.622934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:45.624041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:45.625517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] PATH_INFO: `/v3/users/50534cf3a1494b148d51b248e3960dc7` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:45.651479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50534cf3a1494b148d51b248e3960dc7)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:45.714846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:45.825958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50534cf3a1494b148d51b248e3960dc7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:45.842030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50534cf3a1494b148d51b248e3960dc7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:45.862927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50534cf3a1494b148d51b248e3960dc7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:45.863587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50534cf3a1494b148d51b248e3960dc7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:45.864398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50534cf3a1494b148d51b248e3960dc7'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:45.908029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 999/2006] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:45 2022] DELETE /identity/v3/users/50534cf3a1494b148d51b248e3960dc7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:45.912776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:45.913356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:45.913356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:45.953815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:45.955131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:46.145257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1008/2007] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:46.236031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:46.238235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:46.373189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958f20-8120-451e-b01b-4fbd6f2bf454 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:46.381170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:46.381980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:46.382332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:46.383206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:46.403852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:46.463007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:46.472376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1000/2008] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:47.389842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:47.392724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:47.406176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd003c1b-5390-4457-9878-f227bc3ca01d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:47.412739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:47.413543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:47.413997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:47.414444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] PATH_INFO: `/v3/projects/5aaa651ef1034ff49a9e2f70654dd85c` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:47.415721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aaa651ef1034ff49a9e2f70654dd85c)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:47.463379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:47.574019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aaa651ef1034ff49a9e2f70654dd85c', 'request_id': 'req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.580077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aaa651ef1034ff49a9e2f70654dd85c', 'request_id': 'req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.591293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aaa651ef1034ff49a9e2f70654dd85c', 'request_id': 'req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.616545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] The token cache is being invalidate because project 5aaa651ef1034ff49a9e2f70654dd85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:47.617577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.618589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.624173 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1009/2009] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:47 2022] DELETE /identity/v3/projects/5aaa651ef1034ff49a9e2f70654dd85c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:47.624777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:47.638330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40d2de-34b0-4f2e-97d6-c4f7bf1d67b0 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:47.724299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:47.725123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:47.725410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:47.725745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] PATH_INFO: `/v3/users/cae9f668f70f4922a49fcd08c8a7d05d` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:47.726925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae9f668f70f4922a49fcd08c8a7d05d)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:47.755443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:47.825745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae9f668f70f4922a49fcd08c8a7d05d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.835815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae9f668f70f4922a49fcd08c8a7d05d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.846756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae9f668f70f4922a49fcd08c8a7d05d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.847442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae9f668f70f4922a49fcd08c8a7d05d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.848092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1d3effad-c6da-40c1-822e-091f650bc681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae9f668f70f4922a49fcd08c8a7d05d'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:47.888437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1001/2010] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:47 2022] DELETE /identity/v3/users/cae9f668f70f4922a49fcd08c8a7d05d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:48.620263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:48.621928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:48.676336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f42ec-a2f0-43ed-b33b-26ee7ab6c6af admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:48.780885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:48.781928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:48.782768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:48.783204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] PATH_INFO: `/v3/projects/01312c945ac04dd3911bd238341927a0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:48.785567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01312c945ac04dd3911bd238341927a0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:48.823659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:48.901477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01312c945ac04dd3911bd238341927a0', 'request_id': 'req-39e01179-bcb2-4be2-9e37-9286bc884d17'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:48.908076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01312c945ac04dd3911bd238341927a0', 'request_id': 'req-39e01179-bcb2-4be2-9e37-9286bc884d17'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:48.918855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01312c945ac04dd3911bd238341927a0', 'request_id': 'req-39e01179-bcb2-4be2-9e37-9286bc884d17'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:48.920962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:48.922089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:48.922715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:48.937384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] The token cache is being invalidate because project 01312c945ac04dd3911bd238341927a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:48.937672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:48.938470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:48.943691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1010/2011] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:48 2022] DELETE /identity/v3/projects/01312c945ac04dd3911bd238341927a0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:48:48.944574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:48.946275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:48.965983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] MFA Rules not processed for user `b9ebef92ee034ac788278db5e75054d0`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:48.967413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:49.059843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e01179-bcb2-4be2-9e37-9286bc884d17 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:49.068810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:49.070098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:49.070389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:49.070697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] PATH_INFO: `/v3/users/b45033cb9b4d4e27b17573658d813133` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:49.072282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45033cb9b4d4e27b17573658d813133)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:49.078814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1002/2012] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:48 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:49.086491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:49.088790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:49.103346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:49.196893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249b822-1658-4f0d-b675-332edb663b49 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:49.207705 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:49.208315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:49.208605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:49.208888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:49.209981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45033cb9b4d4e27b17573658d813133'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.211058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:49.223162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45033cb9b4d4e27b17573658d813133'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.224274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45033cb9b4d4e27b17573658d813133'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.241526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45033cb9b4d4e27b17573658d813133'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.249992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45033cb9b4d4e27b17573658d813133'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.258396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1011/2013] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:48:48 2022] DELETE /identity/v3/users/b45033cb9b4d4e27b17573658d813133 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:49.304500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:49.332363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedc074-43b6-43e3-8ed2-eaab1f7d5fad service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:49.345731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1003/2014] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:49 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:48:49.709076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:49.710599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:49.819625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481fd97-1294-4c5e-83b7-e912e952f01c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:49.823972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:49.824942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:49.825219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:49.825500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] PATH_INFO: `/v3/projects/045b826914e745aab05f6874b8b121d4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:49.826633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] RBAC: Authorizing `identity:delete_project(project_id=045b826914e745aab05f6874b8b121d4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:49.852465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:49.912278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045b826914e745aab05f6874b8b121d4', 'request_id': 'req-7d218880-8217-4cff-9180-0d4c5afb953c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.917786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045b826914e745aab05f6874b8b121d4', 'request_id': 'req-7d218880-8217-4cff-9180-0d4c5afb953c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.928886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045b826914e745aab05f6874b8b121d4', 'request_id': 'req-7d218880-8217-4cff-9180-0d4c5afb953c'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.945753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] The token cache is being invalidate because project 045b826914e745aab05f6874b8b121d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:48:49.946036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.946677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7d218880-8217-4cff-9180-0d4c5afb953c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:48:49.948358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1012/2015] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:48:49 2022] DELETE /identity/v3/projects/045b826914e745aab05f6874b8b121d4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:49.953478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:49.954115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:49.954115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:49.984220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:49.985456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:50.051415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1004/2016] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:50.062295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.062619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.062928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.088692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:50.090096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:50.098598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1013/2017] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:48:50.102507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:50.112841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435913c4-b4fe-419b-ae06-20b0ca5f296d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:50.117793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:50.118685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.119149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.119657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.120405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:48:50.120710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:50.147276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:50.163732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1005/2018] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:48:50.170460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:50.184301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544650cf-7b60-45f3-bf2c-b32c35b29d5e None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:50.191499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:50.192229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.192618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.192970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.194104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:50.222016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:50.264438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1014/2019] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:48:50 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:48:50.265088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:50.276643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429cde3-ef38-484d-99d2-de5a09c621f1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:50.366398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:50.367926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.368244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.368696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.369582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:50.405968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:50.432406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1006/2020] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:48:50 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:48:50.433705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:50.444583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d41a9-3e7e-4955-ab21-658479769658 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:50.449395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c878452-2579-4708-b834-578db3d02d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:50.450061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878452-2579-4708-b834-578db3d02d3e admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.450296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878452-2579-4708-b834-578db3d02d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.450602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c878452-2579-4708-b834-578db3d02d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.451385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878452-2579-4708-b834-578db3d02d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:50.478850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c878452-2579-4708-b834-578db3d02d3e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:50.493890 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1015/2021] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:48:50.495117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:50.507997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252986-409c-4516-897b-47401ff468d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:50.513192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:50.514439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.514911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.515414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] PATH_INFO: `/v3/projects/4afe8b34a533497ea03d0a2ec2e5ae53/users/6def7bbc96954b21959b861cd19c6a29/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.541240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afe8b34a533497ea03d0a2ec2e5ae53, user_id=6def7bbc96954b21959b861cd19c6a29, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:50.575149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:50.595718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1007/2022] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:48:50 2022] PUT /identity/v3/projects/4afe8b34a533497ea03d0a2ec2e5ae53/users/6def7bbc96954b21959b861cd19c6a29/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:48:50.605521 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35870-e81a-433e-9175-df6cc209bb78 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.606002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35870-e81a-433e-9175-df6cc209bb78 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.606324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d35870-e81a-433e-9175-df6cc209bb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.674787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-00d35870-e81a-433e-9175-df6cc209bb78 None None] MFA Rules not processed for user `6def7bbc96954b21959b861cd19c6a29`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:50.676018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-00d35870-e81a-433e-9175-df6cc209bb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:50.748378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1016/2023] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:50 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:48:50.766658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:48:50.768470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:50.835085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51153c-05ca-47f4-93c0-000b7f50f01d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:48:50.838588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3caf8a53d924849b5cb756249a1a96f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:48:50.839191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:50.839481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:50.839763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:50.848930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:48:50.874604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:48:50.884524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1008/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:48:50 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:48:51.086200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c64c9-be92-41f9-8efc-96cd1e4f2b1e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:48:51.086501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c64c9-be92-41f9-8efc-96cd1e4f2b1e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:48:51.086831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c64c9-be92-41f9-8efc-96cd1e4f2b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:48:51.109454 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-800c64c9-be92-41f9-8efc-96cd1e4f2b1e None None] MFA Rules not processed for user `fa4639aff93a476ea70ba053c8bad1cb`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:48:51.110757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-800c64c9-be92-41f9-8efc-96cd1e4f2b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:48:51.178468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1017/2025] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:48:51 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:01.353214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:01.355054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:01.511225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952ca4c-7d9d-4e47-a40e-f3dc9d8e9235 service glance] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:01.517336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:01.518137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:01.518425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:01.518739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] PATH_INFO: `/v3/users/f6855d3259e84affadba4eb797f0635c` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:01.519978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6855d3259e84affadba4eb797f0635c)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:01.545649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:01.600854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6855d3259e84affadba4eb797f0635c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:01.610161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6855d3259e84affadba4eb797f0635c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:01.617355 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6855d3259e84affadba4eb797f0635c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:01.618047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6855d3259e84affadba4eb797f0635c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:01.618665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6855d3259e84affadba4eb797f0635c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:01.640450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1009/2026] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:49:01 2022] DELETE /identity/v3/users/f6855d3259e84affadba4eb797f0635c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:01.642264 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:01.642815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:01.642909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:01.686934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:01.688549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:01.763715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1018/2027] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:01.774127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:01.775530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:01.891456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595ead-aee0-4199-8481-b8147c1aa19b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:01.895731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bcf67-eb50-4006-bbc8-70902813886c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:01.896328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcf67-eb50-4006-bbc8-70902813886c service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:01.896673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcf67-eb50-4006-bbc8-70902813886c service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:01.896988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bcf67-eb50-4006-bbc8-70902813886c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:01.908647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bcf67-eb50-4006-bbc8-70902813886c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:01.937288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bcf67-eb50-4006-bbc8-70902813886c service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:01.949672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1010/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:49:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:49:02.324273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:02.330798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:02.345210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87fa0-ffbf-4b4b-a82d-2223fc147189 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:02.349743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:02.350589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.350898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.351197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] PATH_INFO: `/v3/projects/b9c77c708da647a79355697180ce9f3c` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.352270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c77c708da647a79355697180ce9f3c)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:02.378178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:02.430267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c77c708da647a79355697180ce9f3c', 'request_id': 'req-d36ccd34-2d4e-40e9-8367-bf558514f3a2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:02.439198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c77c708da647a79355697180ce9f3c', 'request_id': 'req-d36ccd34-2d4e-40e9-8367-bf558514f3a2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:02.449042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c77c708da647a79355697180ce9f3c', 'request_id': 'req-d36ccd34-2d4e-40e9-8367-bf558514f3a2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:02.465262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] The token cache is being invalidate because project b9c77c708da647a79355697180ce9f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:49:02.465463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:02.466076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d36ccd34-2d4e-40e9-8367-bf558514f3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:02.467557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1019/2029] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:49:02 2022] DELETE /identity/v3/projects/b9c77c708da647a79355697180ce9f3c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:02.474245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.474756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.474834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.526071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:02.527545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:02.612811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1011/2030] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:02.620898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.621297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.621675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.647280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:02.648761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:02.656878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1020/2031] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:49:02.661048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:02.670682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0516-0e57-421b-9391-4a953bee9988 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:02.675985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:02.676449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.676833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.677230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.678117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:49:02.678518 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:02.706685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:02.728728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1012/2032] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:49:02.733559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:02.745174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20d31f-b0fc-4c9d-83ec-6834ad931b7f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:02.753123 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:02.754000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.754368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.754684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.755597 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:02.784958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:02.819927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1021/2033] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:49:02 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:49:02.824252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:02.835399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e6e1-9d0f-4255-813a-b7e9f7238a7f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:02.908242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:02.908975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.909264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.909614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.910266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:02.925805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:02.927630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:02.939741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ceaccb-8760-4801-b9b6-cafe8803c3d5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:02.939907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:02.944428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:02.945276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.945556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.945839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] PATH_INFO: `/v3/users/8389c83df3694d1cb1318e2a37fc1fdb` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.947001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8389c83df3694d1cb1318e2a37fc1fdb)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:02.977309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1013/2034] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:49:02 2022] POST /identity/v3/users => generated 283 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:49:02.977514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:02.978855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:02.989672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bcc1-7467-4c3e-8bc2-d4a22cde0b2c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:02.995134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:02.996274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:02.996649 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:02.997014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:02.997895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:03.025593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:03.030997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8389c83df3694d1cb1318e2a37fc1fdb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.036474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1014/2035] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:49:03.039724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8389c83df3694d1cb1318e2a37fc1fdb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.039832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8389c83df3694d1cb1318e2a37fc1fdb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.040782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:03.052562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0131d-bbf5-4fc0-bfff-f5f2ea7ee116 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:03.052696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8389c83df3694d1cb1318e2a37fc1fdb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.057489 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df493b1e-183b-4278-b4ff-7781b1f0cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:03.058318 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493b1e-183b-4278-b4ff-7781b1f0cdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:03.058632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493b1e-183b-4278-b4ff-7781b1f0cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:03.058921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df493b1e-183b-4278-b4ff-7781b1f0cdb8 admin admin] PATH_INFO: `/v3/projects/6c5575303089477ba42e4ff6e6fe296c/users/3d04302d0c1741dda18ce7d1494cc83c/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:03.060607 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e4bb6b4a-29e9-4536-873e-d15fb0c9f791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8389c83df3694d1cb1318e2a37fc1fdb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.067542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1022/2036] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:49:02 2022] DELETE /identity/v3/users/8389c83df3694d1cb1318e2a37fc1fdb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:49:03.074784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:03.075288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:03.075673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:03.080918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493b1e-183b-4278-b4ff-7781b1f0cdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c5575303089477ba42e4ff6e6fe296c, user_id=3d04302d0c1741dda18ce7d1494cc83c, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:03.097502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:03.099034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:03.107763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df493b1e-183b-4278-b4ff-7781b1f0cdb8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:03.123564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1015/2037] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:49:03 2022] PUT /identity/v3/projects/6c5575303089477ba42e4ff6e6fe296c/users/3d04302d0c1741dda18ce7d1494cc83c/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:03.134863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:03.135309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:03.135614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:03.169587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1023/2038] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:03.177960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] MFA Rules not processed for user `3d04302d0c1741dda18ce7d1494cc83c`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:03.177960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:03.187480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:03.189001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:03.255124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1016/2039] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:03.259204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b452e-f4c3-4047-9cd9-1e94287eab37 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:03.263017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:03.264437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:03.317082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:03.317582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:03.318179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:03.318508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:03.327294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d495307-0192-43f2-a24f-f712289a7864 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:03.331010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:03.331603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:03.331890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:03.332173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:03.340691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:03.366905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:03.378415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1017/2040] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:49:03 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:49:03.405150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:03.430532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:03.440862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1024/2041] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:49:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:49:03.872517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:03.873959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:03.887622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba879-71aa-41a3-9530-13927a406bee service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:03.891707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:03.892502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:03.892793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:03.893078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] PATH_INFO: `/v3/projects/ad95e0b3375849de882cf4dcb62d212e` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:03.894179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad95e0b3375849de882cf4dcb62d212e)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:03.919977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:03.980247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad95e0b3375849de882cf4dcb62d212e', 'request_id': 'req-5073a0f8-8860-4f3d-aa9a-31488d297efb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.985742 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad95e0b3375849de882cf4dcb62d212e', 'request_id': 'req-5073a0f8-8860-4f3d-aa9a-31488d297efb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:03.992973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad95e0b3375849de882cf4dcb62d212e', 'request_id': 'req-5073a0f8-8860-4f3d-aa9a-31488d297efb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.009348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] The token cache is being invalidate because project ad95e0b3375849de882cf4dcb62d212e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:49:04.009606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.010328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.011916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1018/2042] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:49:03 2022] DELETE /identity/v3/projects/ad95e0b3375849de882cf4dcb62d212e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:04.016279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:04.030381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ea640-225c-405b-b0d7-fb0507ecf902 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:04.102865 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:04.103765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:04.104238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:04.104592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] PATH_INFO: `/v3/users/27da2efdca284426bdc4bd393e506d0a` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:04.105791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27da2efdca284426bdc4bd393e506d0a)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:04.131498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:04.190035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27da2efdca284426bdc4bd393e506d0a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.198981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27da2efdca284426bdc4bd393e506d0a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.199858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27da2efdca284426bdc4bd393e506d0a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.214998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27da2efdca284426bdc4bd393e506d0a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.230502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-94dbf5b8-435e-435e-abb9-0151c00bdf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27da2efdca284426bdc4bd393e506d0a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.237436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1025/2043] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:49:04 2022] DELETE /identity/v3/users/27da2efdca284426bdc4bd393e506d0a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:04.617732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:04.619213 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:04.631671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a0f8-8860-4f3d-aa9a-31488d297efb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:04.694016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:04.694901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:04.695191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:04.695474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] PATH_INFO: `/v3/projects/1630ffbdb992482cb95e779f0f616c0a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:04.696628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1630ffbdb992482cb95e779f0f616c0a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:04.722865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:04.775257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1630ffbdb992482cb95e779f0f616c0a', 'request_id': 'req-4b29363c-690b-4a08-890b-b163b55cbd42'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.780662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1630ffbdb992482cb95e779f0f616c0a', 'request_id': 'req-4b29363c-690b-4a08-890b-b163b55cbd42'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.788444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1630ffbdb992482cb95e779f0f616c0a', 'request_id': 'req-4b29363c-690b-4a08-890b-b163b55cbd42'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.808132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] The token cache is being invalidate because project 1630ffbdb992482cb95e779f0f616c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:49:04.808417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.809165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b29363c-690b-4a08-890b-b163b55cbd42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:49:04.811101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1019/2044] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:49:04 2022] DELETE /identity/v3/projects/1630ffbdb992482cb95e779f0f616c0a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:04.816972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:04.816972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:04.816972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:04.854592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:04.856008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:04.956231 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1026/2045] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:04.964229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:04.964699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:04.964791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:04.988658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:04.989842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:04.997109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1020/2046] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:05.001558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.011829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd62d92-d1b4-438e-966b-35aa3b48758c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.017323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.017878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.018114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.018473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.019272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:49:05.019638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.049878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:05.154433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1027/2047] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:49:05.155549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.164929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90709e57-4476-4ae6-8eb6-f5c7d255a4e4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.170217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.170883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.171176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.171458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.172157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.199186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:05.246587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1021/2048] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:49:05 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:49:05.248285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.257858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4402ea7-a979-4d1d-b846-bd2354b1d8a7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.324056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.324719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.325054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.325351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.326001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.352372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:05.374837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1028/2049] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:49:05 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:49:05.378760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.389698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c76cd-f117-4883-a968-24a785c3f22a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.402843 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb3b30-ed66-4e94-9505-ba0d552a662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.403844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3b30-ed66-4e94-9505-ba0d552a662c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.404346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3b30-ed66-4e94-9505-ba0d552a662c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.404931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb3b30-ed66-4e94-9505-ba0d552a662c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.405857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb3b30-ed66-4e94-9505-ba0d552a662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.432376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb3b30-ed66-4e94-9505-ba0d552a662c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:05.444020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1022/2050] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:49:05.448408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.458147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b356cc-08c0-40e3-956d-68ab69c109ff admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.469121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.470170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.470443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.470762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] PATH_INFO: `/v3/projects/39b8ba09cda74999b2e22fa2f0cca653/users/5af224da89f14b5abdb9fcbf9ab25de9/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.498294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b8ba09cda74999b2e22fa2f0cca653, user_id=5af224da89f14b5abdb9fcbf9ab25de9, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.525594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:05.558498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1029/2051] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:49:05 2022] PUT /identity/v3/projects/39b8ba09cda74999b2e22fa2f0cca653/users/5af224da89f14b5abdb9fcbf9ab25de9/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:05.560511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.560913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.561342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.608943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] MFA Rules not processed for user `5af224da89f14b5abdb9fcbf9ab25de9`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:05.614254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:05.708701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1023/2052] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:05 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:49:05.713354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.787066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae95ec-bd3b-4e6b-b554-99bcaedcf22b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.793955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.795154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.795754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.796373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.797664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.826736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:05.862692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1030/2053] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:49:05 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:49:05.867281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:05.878516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687bef8-9cdf-47bc-8335-b61fa378ab47 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:05.956307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:05.957109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:05.957495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:05.957876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:05.958636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:05.993377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.019414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1024/2054] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:49:05 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:49:06.023371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:06.034004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc61e2-3872-4d17-bd3b-95da94536596 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:06.038932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:06.039703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.040291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.040815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.041912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:06.072529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.085043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1031/2055] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:49:06.091271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:06.102111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010f420-6aae-4efc-a304-fd9c0f937ab9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:06.106358 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:06.107296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.107697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.108230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] PATH_INFO: `/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3/users/182859c8b9e2496f8c65e2e2865773fa/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.138446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c4da4ee0cb429693a64ad0e7d34fa3, user_id=182859c8b9e2496f8c65e2e2865773fa, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:06.184629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.208799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1025/2056] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:49:06 2022] PUT /identity/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3/users/182859c8b9e2496f8c65e2e2865773fa/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:06.213013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:06.232957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd9dd-12be-40cf-bdc2-732cf9b86336 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:06.357385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:06.358141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.358530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.359051 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.360041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:06.404486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.423320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1032/2057] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:49:06.425071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:06.435292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2943a-dc0f-41dc-89ef-8490d3802ec3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:06.439787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:06.440593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.440878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.441157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] PATH_INFO: `/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3/users/182859c8b9e2496f8c65e2e2865773fa/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.443342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c4da4ee0cb429693a64ad0e7d34fa3, user_id=182859c8b9e2496f8c65e2e2865773fa, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:06.479496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.497660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1026/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:49:06 2022] PUT /identity/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3/users/182859c8b9e2496f8c65e2e2865773fa/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:06.502816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:06.513604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc3068-47f1-4dc0-9470-a1befd1a7d94 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:06.604486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1147a-f0c2-48c3-9579-2a3a16ff7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:06.605303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1147a-f0c2-48c3-9579-2a3a16ff7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.605694 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1147a-f0c2-48c3-9579-2a3a16ff7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.606075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1147a-f0c2-48c3-9579-2a3a16ff7ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.607014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1147a-f0c2-48c3-9579-2a3a16ff7ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:06.636315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1147a-f0c2-48c3-9579-2a3a16ff7ff2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.654204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1033/2059] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:49:06.657034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:06.669701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb34a88-78b6-4431-a191-e7b6533ef1b3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:06.688968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:06.690088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.690532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.690970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] PATH_INFO: `/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3/users/182859c8b9e2496f8c65e2e2865773fa/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.694605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c4da4ee0cb429693a64ad0e7d34fa3, user_id=182859c8b9e2496f8c65e2e2865773fa, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:06.745634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:06.803136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1027/2060] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:49:06 2022] PUT /identity/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3/users/182859c8b9e2496f8c65e2e2865773fa/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:49:06.804046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:06.804349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:06.804633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:06.963997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] MFA Rules not processed for user `182859c8b9e2496f8c65e2e2865773fa`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:06.968577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:07.118806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1034/2061] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:06 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:49:07.129577 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:07.131217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:07.205185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46396621-4e4f-4e61-8bc7-62d2e2a54233 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:07.208728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d0e4c-f95d-4409-ac13-e5527c40a5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:07.209312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d0e4c-f95d-4409-ac13-e5527c40a5db service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:07.209603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d0e4c-f95d-4409-ac13-e5527c40a5db service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:07.209887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d0e4c-f95d-4409-ac13-e5527c40a5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:07.275926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d0e4c-f95d-4409-ac13-e5527c40a5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:07.301445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d0e4c-f95d-4409-ac13-e5527c40a5db service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:07.310597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1028/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:49:07 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:49:20.167229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:49:20.179047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb886ad-9f96-4003-a87a-57655970d4dc None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:49:20.182353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:49:20.182918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:20.183204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:20.183482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:20.194596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:49:20.221476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:49:20.233100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1035/2063] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:49:20 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:49:20.964930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:49:20.965471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:49:20.965471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:49:20.989767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] MFA Rules not processed for user `45a491cd7bb8422fb6e3ee727d7b15f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:49:20.990934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:49:21.054176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1029/2064] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:49:20 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:03.359091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:03.360581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:03.472645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f4f8-ab92-4fa7-83fa-edd63c0d5364 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:03.478359 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:03.478967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:03.479342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:03.479633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:03.481598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:03.492511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:03.518136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b86c4-6b95-4c74-aac8-05941c2c4446 service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:03.528995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1036/2065] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:03 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:33.791367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:33.868672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200dfe-2b71-45c2-b692-87bc964cd99a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:33.873788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:33.874598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:33.874883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:33.875169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] PATH_INFO: `/v3/users/5af224da89f14b5abdb9fcbf9ab25de9` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:33.876360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af224da89f14b5abdb9fcbf9ab25de9)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:33.901682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:33.956920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af224da89f14b5abdb9fcbf9ab25de9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:33.965997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af224da89f14b5abdb9fcbf9ab25de9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:33.977496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af224da89f14b5abdb9fcbf9ab25de9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:33.977753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af224da89f14b5abdb9fcbf9ab25de9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:33.978496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af224da89f14b5abdb9fcbf9ab25de9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.005047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1030/2066] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:33 2022] DELETE /identity/v3/users/5af224da89f14b5abdb9fcbf9ab25de9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:34.010215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:34.011164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:34.013169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:34.041621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:34.042892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:34.107940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1037/2067] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:34.121431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:34.123130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:34.188107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d446c-87c2-44f1-9cb0-6f26af1a5800 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:34.192022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:34.192606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:34.192892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:34.193169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:34.202155 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:34.227460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:34.237848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1031/2068] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:50:34.596775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:34.598125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:34.614630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ded80f-ee07-4429-b077-f200d256d638 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:34.633287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:34.634070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:34.634357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:34.634668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] PATH_INFO: `/v3/projects/39b8ba09cda74999b2e22fa2f0cca653` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:34.636185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b8ba09cda74999b2e22fa2f0cca653)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:34.662876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:34.717594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b8ba09cda74999b2e22fa2f0cca653', 'request_id': 'req-82587035-2292-4dc0-bd70-bba8ac07042e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.722535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b8ba09cda74999b2e22fa2f0cca653', 'request_id': 'req-82587035-2292-4dc0-bd70-bba8ac07042e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.729870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b8ba09cda74999b2e22fa2f0cca653', 'request_id': 'req-82587035-2292-4dc0-bd70-bba8ac07042e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.746709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] The token cache is being invalidate because project 39b8ba09cda74999b2e22fa2f0cca653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:34.746990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.747752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.749190 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1038/2069] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:34 2022] DELETE /identity/v3/projects/39b8ba09cda74999b2e22fa2f0cca653 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:34.753272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:34.762907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d421e-3f88-4d33-9539-69a9471ab502 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:34.831558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:34.832560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:34.832932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:34.833274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] PATH_INFO: `/v3/users/182859c8b9e2496f8c65e2e2865773fa` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:34.834550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182859c8b9e2496f8c65e2e2865773fa)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:34.860691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:34.916158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182859c8b9e2496f8c65e2e2865773fa'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.924469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182859c8b9e2496f8c65e2e2865773fa'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.933904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182859c8b9e2496f8c65e2e2865773fa'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.934588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182859c8b9e2496f8c65e2e2865773fa'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.935423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-572fb5ab-7cd4-4380-ba87-380932b15f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182859c8b9e2496f8c65e2e2865773fa'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:34.954782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1032/2070] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:34 2022] DELETE /identity/v3/users/182859c8b9e2496f8c65e2e2865773fa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:35.424412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:35.426743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:35.439749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82587035-2292-4dc0-bd70-bba8ac07042e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:35.503165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:35.503953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:35.504234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:35.504516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] PATH_INFO: `/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:35.505631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c4da4ee0cb429693a64ad0e7d34fa3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:35.531292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:35.583894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c4da4ee0cb429693a64ad0e7d34fa3', 'request_id': 'req-a10f943e-df74-4be5-aa97-95b675b64c0e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:35.589073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c4da4ee0cb429693a64ad0e7d34fa3', 'request_id': 'req-a10f943e-df74-4be5-aa97-95b675b64c0e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:35.597879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c4da4ee0cb429693a64ad0e7d34fa3', 'request_id': 'req-a10f943e-df74-4be5-aa97-95b675b64c0e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:35.615262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] The token cache is being invalidate because project 53c4da4ee0cb429693a64ad0e7d34fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:35.615545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:35.616209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10f943e-df74-4be5-aa97-95b675b64c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:35.617707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1039/2071] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:35 2022] DELETE /identity/v3/projects/53c4da4ee0cb429693a64ad0e7d34fa3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:35.622895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:35.623185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:35.623480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:35.658700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:35.659899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:35.729523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1033/2072] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:35.738178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:35.738471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:35.738790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:35.761438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:35.762825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:35.770226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1040/2073] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:35.774516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:35.784514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87c733-c103-48f9-8d1b-c3bfe59afdea None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:35.789440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:35.790025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:35.790303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:35.790600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:35.791289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:50:35.791602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:35.818749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:35.834924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1034/2074] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:50:35.841661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:35.855847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ab05-c636-4115-ac68-b44001128504 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:35.860932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:35.861514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:35.861798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:35.862082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:35.862752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:35.888311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:35.922512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1041/2075] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:50:35 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:35.927451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:35.943273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeaadf-bf16-4aad-a883-3046237058bb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.014520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.015150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.015586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.015880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.016519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.042406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.064837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1035/2076] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:50:35 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:36.069212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.079632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2722a-ec72-4228-a911-3e52cd8991ae admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.085422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8c8ae-845f-46ac-89be-c943294f887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.086288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8c8ae-845f-46ac-89be-c943294f887d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.086709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8c8ae-845f-46ac-89be-c943294f887d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.086984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8c8ae-845f-46ac-89be-c943294f887d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.087858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8c8ae-845f-46ac-89be-c943294f887d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.114175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8c8ae-845f-46ac-89be-c943294f887d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.124949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1042/2077] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:50:36.130494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.146266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a23c-4fe5-4126-983c-92dcc29254a1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.153366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.154220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.154513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.154829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] PATH_INFO: `/v3/projects/8acc4c1d74ec440aa36583605493daa1/users/1eb0d7f488f949ca8dae55179e761e57/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.176427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acc4c1d74ec440aa36583605493daa1, user_id=1eb0d7f488f949ca8dae55179e761e57, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.203680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.220394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1036/2078] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:36 2022] PUT /identity/v3/projects/8acc4c1d74ec440aa36583605493daa1/users/1eb0d7f488f949ca8dae55179e761e57/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:36.230395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.230732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.231014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.267933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] MFA Rules not processed for user `1eb0d7f488f949ca8dae55179e761e57`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:36.269180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:36.349167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1043/2079] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:36 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:36.354086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.423467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af05b6-e195-4aa2-98b0-576fca465808 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.427969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.428561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.428846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.429124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.429755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.455931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.491312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1037/2080] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:50:36 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:36.495447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.507215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f317e7-1c03-4929-bc0e-b16e3b229deb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.570404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.571050 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.571334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.571608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.572261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.598639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.619682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1044/2081] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:50:36 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:50:36.624380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.634848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c409f-2a09-4c19-9463-d4664db14436 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.639782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.640371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.640660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.640940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.641639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.667733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.679501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1038/2082] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:36.684214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.699215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726db0b-9db9-4fdd-988c-210054e9ff37 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.704187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.705037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.705321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.705601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] PATH_INFO: `/v3/projects/2a30598e2a65499db4f9d99eed69ed09/users/4dd4f9a11bfc4e8591c5bca26b07be18/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.731275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a30598e2a65499db4f9d99eed69ed09, user_id=4dd4f9a11bfc4e8591c5bca26b07be18, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.762787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.779316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1045/2083] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:36 2022] PUT /identity/v3/projects/2a30598e2a65499db4f9d99eed69ed09/users/4dd4f9a11bfc4e8591c5bca26b07be18/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:50:36.783428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.793190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3cac6-5f2e-461d-8598-72e9eccf6c2a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.857703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.858343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.858582 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.858876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.859560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.885175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.895746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1039/2084] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:36.900675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.916462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745ddc0-88cc-4061-9304-462b2f480eed admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:36.924871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:36.926047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:36.926379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:36.926825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] PATH_INFO: `/v3/projects/2a30598e2a65499db4f9d99eed69ed09/users/4dd4f9a11bfc4e8591c5bca26b07be18/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:36.930058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a30598e2a65499db4f9d99eed69ed09, user_id=4dd4f9a11bfc4e8591c5bca26b07be18, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:36.957822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:36.969404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1046/2085] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:36 2022] PUT /identity/v3/projects/2a30598e2a65499db4f9d99eed69ed09/users/4dd4f9a11bfc4e8591c5bca26b07be18/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:36.973978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:36.990311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d0c75-b231-45ff-9b86-89c7691382d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:37.063029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffae7b6-1aff-476b-bde8-216eb879f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:37.063618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffae7b6-1aff-476b-bde8-216eb879f8da admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:37.063904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffae7b6-1aff-476b-bde8-216eb879f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:37.064519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffae7b6-1aff-476b-bde8-216eb879f8da admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:37.065209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffae7b6-1aff-476b-bde8-216eb879f8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:37.090995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffae7b6-1aff-476b-bde8-216eb879f8da admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:37.101755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1040/2086] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:37.107507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:37.117833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3b288-61ff-4209-9ccf-26a4d0a81db6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:37.123988 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:37.124832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:37.125110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:37.125617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] PATH_INFO: `/v3/projects/2a30598e2a65499db4f9d99eed69ed09/users/4dd4f9a11bfc4e8591c5bca26b07be18/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:37.128683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a30598e2a65499db4f9d99eed69ed09, user_id=4dd4f9a11bfc4e8591c5bca26b07be18, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:37.160773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:37.179466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1047/2087] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:37 2022] PUT /identity/v3/projects/2a30598e2a65499db4f9d99eed69ed09/users/4dd4f9a11bfc4e8591c5bca26b07be18/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:37.189690 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:37.189979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:37.190260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:37.308673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] MFA Rules not processed for user `4dd4f9a11bfc4e8591c5bca26b07be18`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:37.309993 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:37.396224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1041/2088] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:37 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:37.405923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:37.407825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:37.513626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85a95-a39b-4bd9-bb5b-0d30e4d40cc2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:37.517405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39fd7e-9430-42c8-9378-8723f6bd9742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:37.517993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fd7e-9430-42c8-9378-8723f6bd9742 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:37.518280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fd7e-9430-42c8-9378-8723f6bd9742 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:37.518581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fd7e-9430-42c8-9378-8723f6bd9742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:37.528188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39fd7e-9430-42c8-9378-8723f6bd9742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:37.553100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39fd7e-9430-42c8-9378-8723f6bd9742 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:37.562827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1048/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:37 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:38.151310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:38.224617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc42d90-c663-44bb-a84a-9255f436d73d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:38.229486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:38.230493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:38.230814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:38.231096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] PATH_INFO: `/v3/users/1eb0d7f488f949ca8dae55179e761e57` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:38.232292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb0d7f488f949ca8dae55179e761e57)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:38.261313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:38.316070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb0d7f488f949ca8dae55179e761e57'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:38.324440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb0d7f488f949ca8dae55179e761e57'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:38.331952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb0d7f488f949ca8dae55179e761e57'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:38.332829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb0d7f488f949ca8dae55179e761e57'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:38.333505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb0d7f488f949ca8dae55179e761e57'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:38.351168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1042/2090] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:38 2022] DELETE /identity/v3/users/1eb0d7f488f949ca8dae55179e761e57 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:38.355842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:38.356116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:38.356404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:38.378739 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:38.379897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:38.453085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1049/2091] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:38.463543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:38.465056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:38.527322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af22bd3-8606-4e31-bae1-570deda85d9f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:38.531302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:38.531881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:38.532167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:38.532448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:38.541676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:38.567597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:38.576994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1043/2092] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:38.928888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:38.930298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:38.942853 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ca15e-ae0b-4252-b58d-3e2c54a17893 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:38.954349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:38.955192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:38.955478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:38.955754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] PATH_INFO: `/v3/projects/8acc4c1d74ec440aa36583605493daa1` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:38.956970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acc4c1d74ec440aa36583605493daa1)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:38.983220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:39.039424 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acc4c1d74ec440aa36583605493daa1', 'request_id': 'req-075c0e7e-216b-4581-bd0b-5d27885975ac'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.045040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acc4c1d74ec440aa36583605493daa1', 'request_id': 'req-075c0e7e-216b-4581-bd0b-5d27885975ac'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.053757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acc4c1d74ec440aa36583605493daa1', 'request_id': 'req-075c0e7e-216b-4581-bd0b-5d27885975ac'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.071093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] The token cache is being invalidate because project 8acc4c1d74ec440aa36583605493daa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:39.071382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.072077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.073729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1050/2093] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:38 2022] DELETE /identity/v3/projects/8acc4c1d74ec440aa36583605493daa1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:50:39.077809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:39.087227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca6538-d615-40ac-ac4e-5f4896bb032f service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:39.150923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:39.151740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:39.152320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:39.152418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] PATH_INFO: `/v3/users/4dd4f9a11bfc4e8591c5bca26b07be18` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:39.153643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd4f9a11bfc4e8591c5bca26b07be18)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:39.179457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:39.231246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd4f9a11bfc4e8591c5bca26b07be18'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.238788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd4f9a11bfc4e8591c5bca26b07be18'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.247820 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd4f9a11bfc4e8591c5bca26b07be18'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.248490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd4f9a11bfc4e8591c5bca26b07be18'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.249091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88bfe147-968f-4b59-8894-33c9f0e63974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd4f9a11bfc4e8591c5bca26b07be18'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.266450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1044/2094] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:39 2022] DELETE /identity/v3/users/4dd4f9a11bfc4e8591c5bca26b07be18 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:39.649001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:39.650453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:39.663554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c0e7e-216b-4581-bd0b-5d27885975ac admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:39.730922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:39.731721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:39.731997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:39.732290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] PATH_INFO: `/v3/projects/2a30598e2a65499db4f9d99eed69ed09` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:39.733412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a30598e2a65499db4f9d99eed69ed09)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:39.758783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:39.817293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a30598e2a65499db4f9d99eed69ed09', 'request_id': 'req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.823464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a30598e2a65499db4f9d99eed69ed09', 'request_id': 'req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.832389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a30598e2a65499db4f9d99eed69ed09', 'request_id': 'req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.857457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] The token cache is being invalidate because project 2a30598e2a65499db4f9d99eed69ed09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:39.857778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.859180 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-a10cf4dd-ce59-4090-b9f0-81e0da86c1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:39.861469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1051/2095] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:39 2022] DELETE /identity/v3/projects/2a30598e2a65499db4f9d99eed69ed09 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:39.866645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:39.866907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:39.867189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:39.893353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:39.894505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:39.961212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1045/2096] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:39.969334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:39.969860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:39.969860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:39.992762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:39.994103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:40.001776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1052/2097] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:40.006054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:40.015488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e71c-9557-46a0-bada-e43efd37dad2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:40.019821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:40.020419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.020693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.020970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.021658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:50:40.021954 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:40.048076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:40.061598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1046/2098] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:50:40.066352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:40.075532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01dd1-524b-4c4d-aca7-60155840a5bf None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:40.080763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:40.081479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.081759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.082034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.082712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:40.108886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:40.141441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1053/2099] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:50:40 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:50:40.145557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:40.156574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2174-9045-4521-80cd-ecbcb8fe446a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:40.224587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:40.225195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.225478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.225760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.226598 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:40.252819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:40.273402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1047/2100] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:50:40 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:40.277509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:40.287129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef222032-8eed-4b97-a6af-c5e91dca0707 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:40.291321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c11d-8742-4b38-8324-a49d1455cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:40.291871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c11d-8742-4b38-8324-a49d1455cf03 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.292348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c11d-8742-4b38-8324-a49d1455cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.292800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c11d-8742-4b38-8324-a49d1455cf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.293708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8c11d-8742-4b38-8324-a49d1455cf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:40.320182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8c11d-8742-4b38-8324-a49d1455cf03 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:40.331961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1054/2101] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:40.336274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:40.346595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5efc7f-cc68-4bad-ac08-8c6918eabf2b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:40.350910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:40.351731 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.352012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.352288 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] PATH_INFO: `/v3/projects/961d65354d6445ea9e56a757958f2cb7/users/3821c97d9af346f9bd0213613abdfce4/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.372949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=961d65354d6445ea9e56a757958f2cb7, user_id=3821c97d9af346f9bd0213613abdfce4, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:40.399646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:40.414114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1048/2102] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:40 2022] PUT /identity/v3/projects/961d65354d6445ea9e56a757958f2cb7/users/3821c97d9af346f9bd0213613abdfce4/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:50:40.420066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c8d9-1052-425c-a76c-8dfecacd460e None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.420538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c8d9-1052-425c-a76c-8dfecacd460e None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.420821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c8d9-1052-425c-a76c-8dfecacd460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.443011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e576c8d9-1052-425c-a76c-8dfecacd460e None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:40.444134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e576c8d9-1052-425c-a76c-8dfecacd460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:40.514347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1055/2103] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:40.524683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:40.526375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:40.593935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb830d-3cb9-42b0-9153-d4c7b711f62d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:40.597512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:40.598091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:40.598372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:40.598664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:40.607656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:40.632936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:40.643342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1049/2104] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:50:41.443538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:41.444053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:41.444158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:41.482580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] MFA Rules not processed for user `3821c97d9af346f9bd0213613abdfce4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:41.483752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:41.558476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1056/2105] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:41.563048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:41.572908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82de42-73f2-4bd0-9b1e-a01a21305095 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:41.577300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:41.577888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:41.578178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:41.578462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:41.579593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:41.605816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:41.647020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1050/2106] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:50:41 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:41.650860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:41.661982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8519e-2ce3-4d4a-be98-fc6a0b95ed6c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:41.732392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:41.732997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:41.733280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:41.733558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:41.734201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:41.760360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:41.782191 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1057/2107] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:50:41 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:41.786199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:41.796500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff7b63-1253-431b-8406-7db6acc8cb14 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:41.800765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:41.801375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:41.801662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:41.801927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:41.802667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:41.828344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:41.843452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1051/2108] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:41.847633 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:41.857378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b63c-901f-482c-9fb7-5e07b6b531d7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:41.861681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:41.862498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:41.862817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:41.863096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] PATH_INFO: `/v3/projects/90676eb821f54150818a3fb70dc81db4/users/42e7289008a0459cb643cb67cfb91ad5/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:41.884686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90676eb821f54150818a3fb70dc81db4, user_id=42e7289008a0459cb643cb67cfb91ad5, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:41.910887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:41.926292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1058/2109] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:41 2022] PUT /identity/v3/projects/90676eb821f54150818a3fb70dc81db4/users/42e7289008a0459cb643cb67cfb91ad5/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:41.931119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:41.947461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7721c-c104-4788-bcf9-2970d21e58e3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:42.013290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:42.013887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:42.014173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:42.014448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:42.015169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:42.040507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:42.051108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1052/2110] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:42.057099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:42.068280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230139d1-f7ee-43e8-805b-66d0da06cc46 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:42.074069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:42.074928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:42.075209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:42.075486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] PATH_INFO: `/v3/projects/90676eb821f54150818a3fb70dc81db4/users/42e7289008a0459cb643cb67cfb91ad5/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:42.077706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90676eb821f54150818a3fb70dc81db4, user_id=42e7289008a0459cb643cb67cfb91ad5, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:42.103741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:42.114878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1059/2111] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:42 2022] PUT /identity/v3/projects/90676eb821f54150818a3fb70dc81db4/users/42e7289008a0459cb643cb67cfb91ad5/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:50:42.118876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:42.129073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a338ad-eaeb-4668-8928-556b9737bfd3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:42.200078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3065038-87f8-43ad-8151-ae68f1f4a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:42.200299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3065038-87f8-43ad-8151-ae68f1f4a4ba admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:42.205952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3065038-87f8-43ad-8151-ae68f1f4a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:42.205952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3065038-87f8-43ad-8151-ae68f1f4a4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:42.205952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3065038-87f8-43ad-8151-ae68f1f4a4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:42.228317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3065038-87f8-43ad-8151-ae68f1f4a4ba admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:42.239526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1053/2112] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:42.243652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:42.254519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280f10-321a-40e6-91ff-c993fd80ccb8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:42.258814 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:42.259620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:42.259897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:42.260189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] PATH_INFO: `/v3/projects/90676eb821f54150818a3fb70dc81db4/users/42e7289008a0459cb643cb67cfb91ad5/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:42.262544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90676eb821f54150818a3fb70dc81db4, user_id=42e7289008a0459cb643cb67cfb91ad5, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:42.288933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:42.310411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1060/2113] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:42 2022] PUT /identity/v3/projects/90676eb821f54150818a3fb70dc81db4/users/42e7289008a0459cb643cb67cfb91ad5/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:43.238068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:43.238623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:43.238796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:43.281906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] MFA Rules not processed for user `42e7289008a0459cb643cb67cfb91ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:43.284228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:43.415299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1054/2114] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:43.425789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:43.427476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:43.495113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d11f-774c-4538-82dc-329ddb63dcc7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:43.498908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:43.499491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:43.499775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:43.500048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:43.569758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:43.595615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:43.605254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1061/2115] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:46.238634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:46.248709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40639f66-b00e-475c-86fc-933fa2da2f81 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:46.252962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf484d2-7e32-4200-8b8f-c4969a5c9d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:46.253535 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf484d2-7e32-4200-8b8f-c4969a5c9d2f service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:46.253817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf484d2-7e32-4200-8b8f-c4969a5c9d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:46.254093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf484d2-7e32-4200-8b8f-c4969a5c9d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:46.263864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf484d2-7e32-4200-8b8f-c4969a5c9d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:46.289016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf484d2-7e32-4200-8b8f-c4969a5c9d2f service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:46.299198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1055/2116] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:46 2022] GET /identity/v3/auth/tokens => generated 3745 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:50.328027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:50.328982 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:50.408841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a39f-1b31-42f9-9da2-60c749699970 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:50.412991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:50.413859 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:50.414206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:50.414489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] PATH_INFO: `/v3/users/6def7bbc96954b21959b861cd19c6a29` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:50.415615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6def7bbc96954b21959b861cd19c6a29)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:50.442970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:50.496659 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6def7bbc96954b21959b861cd19c6a29'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:50.505737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6def7bbc96954b21959b861cd19c6a29'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:50.506513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6def7bbc96954b21959b861cd19c6a29'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:50.525570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6def7bbc96954b21959b861cd19c6a29'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:50.534512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6def7bbc96954b21959b861cd19c6a29'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:50.541740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1062/2117] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:50 2022] DELETE /identity/v3/users/6def7bbc96954b21959b861cd19c6a29 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:50.546806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:50.547378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:50.547378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:50.571672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:50.572815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:50.654384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1056/2118] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:50.668442 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:50.670399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:50.737328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3bab5-cc85-4a55-8a1c-77a667227499 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:50.740763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ee09-a654-4bfc-ac6b-7b0ddb51e93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:50.741347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ee09-a654-4bfc-ac6b-7b0ddb51e93a service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:50.741629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ee09-a654-4bfc-ac6b-7b0ddb51e93a service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:50.745515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ee09-a654-4bfc-ac6b-7b0ddb51e93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:50.752293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72ee09-a654-4bfc-ac6b-7b0ddb51e93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:50.778104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72ee09-a654-4bfc-ac6b-7b0ddb51e93a service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:50.787792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1063/2119] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:51.207487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:51.215867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:51.240994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324aea3-a8c9-4f40-ba5f-f768c6620cb2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:51.249952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:51.250922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.251379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.251884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] PATH_INFO: `/v3/projects/4afe8b34a533497ea03d0a2ec2e5ae53` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.254083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afe8b34a533497ea03d0a2ec2e5ae53)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:51.280222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:51.332010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afe8b34a533497ea03d0a2ec2e5ae53', 'request_id': 'req-d9829cac-98dc-4aba-aa05-ec51b7380ae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:51.337368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afe8b34a533497ea03d0a2ec2e5ae53', 'request_id': 'req-d9829cac-98dc-4aba-aa05-ec51b7380ae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:51.344193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afe8b34a533497ea03d0a2ec2e5ae53', 'request_id': 'req-d9829cac-98dc-4aba-aa05-ec51b7380ae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:51.359813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] The token cache is being invalidate because project 4afe8b34a533497ea03d0a2ec2e5ae53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:51.360097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:51.360710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d9829cac-98dc-4aba-aa05-ec51b7380ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:51.362141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1057/2120] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:51 2022] DELETE /identity/v3/projects/4afe8b34a533497ea03d0a2ec2e5ae53 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:51.367126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.367649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.367649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.394093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:51.395270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:51.467666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1064/2121] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:51.475373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.475670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.475967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.498516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:51.499639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:51.507323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1058/2122] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:51.511946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:51.521464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c27a9-7b2e-46d8-a2cd-9ab7bc7e126f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:51.525955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:51.526727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.527252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.527532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.528343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:50:51.528729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:51.557624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:51.576987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1065/2123] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:50:51.578476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:51.587585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35b00a-79d1-47f0-8d0f-2609a8b51f68 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:51.593650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:51.594240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.594594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.594887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.595528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:51.630227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:51.653100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1059/2124] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:50:51 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:51.657406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:51.667160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751a8c-81a9-4511-96c8-cc85b34a9d5a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:51.729179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:51.730343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.730631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.730919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.731568 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:51.757524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:51.781012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1066/2125] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:50:51 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:50:51.785462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:51.800139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476ea9-2dad-487d-bc03-0404be59ab8f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:51.806079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643fcbc-9b9c-461c-947a-1a7b775bf777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:51.806797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fcbc-9b9c-461c-947a-1a7b775bf777 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.807143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fcbc-9b9c-461c-947a-1a7b775bf777 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.807418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643fcbc-9b9c-461c-947a-1a7b775bf777 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.809228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fcbc-9b9c-461c-947a-1a7b775bf777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:51.845697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643fcbc-9b9c-461c-947a-1a7b775bf777 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:51.859451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1060/2126] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:51.863451 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:51.875615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2cfd-e0c7-4476-afd2-c19d2bf97180 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:51.882276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:51.882276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.882276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.882276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] PATH_INFO: `/v3/projects/c0f8d78826c14feabe62e87679be3396/users/64cf8dabc7a0435ba1e9a383c7c59bdd/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:51.910535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f8d78826c14feabe62e87679be3396, user_id=64cf8dabc7a0435ba1e9a383c7c59bdd, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:51.942323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:51.958225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1067/2127] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:51 2022] PUT /identity/v3/projects/c0f8d78826c14feabe62e87679be3396/users/64cf8dabc7a0435ba1e9a383c7c59bdd/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:51.969421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:51.969805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:51.970182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:52.007127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] MFA Rules not processed for user `64cf8dabc7a0435ba1e9a383c7c59bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:52.008327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:52.083616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1061/2128] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:50:52.163714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:52.166382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:52.250948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d87ef3-70dd-4ff1-b8e3-e6cd67c75e30 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:52.255610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd1e7c-28dc-4e1d-ae1c-63145f6d8421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:52.256272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1e7c-28dc-4e1d-ae1c-63145f6d8421 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:52.256625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1e7c-28dc-4e1d-ae1c-63145f6d8421 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:52.257019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd1e7c-28dc-4e1d-ae1c-63145f6d8421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:52.267962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1e7c-28dc-4e1d-ae1c-63145f6d8421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:52.294027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd1e7c-28dc-4e1d-ae1c-63145f6d8421 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:52.303510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1068/2129] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:52 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:52.329901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:52.400283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce592e8-e09e-4818-ad00-a3082686e8e5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:52.404657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:52.405464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:52.405748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:52.406027 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] PATH_INFO: `/v3/users/64cf8dabc7a0435ba1e9a383c7c59bdd` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:52.407133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64cf8dabc7a0435ba1e9a383c7c59bdd)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:52.433718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:52.486670 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64cf8dabc7a0435ba1e9a383c7c59bdd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:52.494845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64cf8dabc7a0435ba1e9a383c7c59bdd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:52.504105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64cf8dabc7a0435ba1e9a383c7c59bdd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:52.504891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64cf8dabc7a0435ba1e9a383c7c59bdd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:52.505722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64cf8dabc7a0435ba1e9a383c7c59bdd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:52.525409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1062/2130] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:52 2022] DELETE /identity/v3/users/64cf8dabc7a0435ba1e9a383c7c59bdd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:52.530418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:52.530952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:52.531134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:52.562171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:52.563805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:52.639868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1069/2131] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:52.649953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:52.651494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:52.726041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7df5-d92d-4f4a-8d0f-c4c8689a5d0d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:52.729353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:52.730493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:52.730811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:52.731092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:52.740013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:52.767530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:52.779380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1063/2132] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:53.281065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:53.282439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:53.303390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c9a6a-822d-4304-9b2a-9c371878615b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:53.308446 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:53.309983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:53.310341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:53.310742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] PATH_INFO: `/v3/projects/c0f8d78826c14feabe62e87679be3396` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:53.311907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f8d78826c14feabe62e87679be3396)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:53.339286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:53.400872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f8d78826c14feabe62e87679be3396', 'request_id': 'req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:53.407473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f8d78826c14feabe62e87679be3396', 'request_id': 'req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:53.415660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f8d78826c14feabe62e87679be3396', 'request_id': 'req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:53.432490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] The token cache is being invalidate because project c0f8d78826c14feabe62e87679be3396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:53.432651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:53.433802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fb276ba7-4e3b-467d-9c40-96b8ff27d91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:53.450588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1070/2133] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:53 2022] DELETE /identity/v3/projects/c0f8d78826c14feabe62e87679be3396 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:53.935405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:53.936814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:53.949466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f90e9-9688-4ebf-aa6e-c9f7bc1e1997 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:54.019041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:54.019853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:54.020236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:54.020629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] PATH_INFO: `/v3/users/3d04302d0c1741dda18ce7d1494cc83c` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:54.021856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d04302d0c1741dda18ce7d1494cc83c)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:54.049999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:54.102831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d04302d0c1741dda18ce7d1494cc83c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.110860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d04302d0c1741dda18ce7d1494cc83c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.119496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d04302d0c1741dda18ce7d1494cc83c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.120124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d04302d0c1741dda18ce7d1494cc83c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.120915 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d04302d0c1741dda18ce7d1494cc83c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.137673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1064/2134] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:50:53 2022] DELETE /identity/v3/users/3d04302d0c1741dda18ce7d1494cc83c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:54.142406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:54.142977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:54.143086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:54.164755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:54.165907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:54.232224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1071/2135] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:54.244352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:54.245727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:54.327226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1cc5c-768c-4b02-80d3-bde796aa2a6f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:54.331272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756ad91-d8f9-46a3-bed5-a036dd076218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:54.331893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756ad91-d8f9-46a3-bed5-a036dd076218 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:54.332217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756ad91-d8f9-46a3-bed5-a036dd076218 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:54.332502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756ad91-d8f9-46a3-bed5-a036dd076218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:54.342067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756ad91-d8f9-46a3-bed5-a036dd076218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:54.367623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756ad91-d8f9-46a3-bed5-a036dd076218 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:54.377313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1065/2136] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:50:54.843746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:54.845350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:54.864234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382cee6-5359-499c-bf88-e70a282673f6 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:54.868519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:54.869325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:54.869613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:54.869893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] PATH_INFO: `/v3/projects/6c5575303089477ba42e4ff6e6fe296c` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:54.875437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c5575303089477ba42e4ff6e6fe296c)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:54.896849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:54.962586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c5575303089477ba42e4ff6e6fe296c', 'request_id': 'req-0499e785-2094-4b36-b329-7b5f638afa2f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.970324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c5575303089477ba42e4ff6e6fe296c', 'request_id': 'req-0499e785-2094-4b36-b329-7b5f638afa2f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:54.983163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c5575303089477ba42e4ff6e6fe296c', 'request_id': 'req-0499e785-2094-4b36-b329-7b5f638afa2f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:55.021605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] The token cache is being invalidate because project 6c5575303089477ba42e4ff6e6fe296c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:50:55.021897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:55.023695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0499e785-2094-4b36-b329-7b5f638afa2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:50:55.030152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1072/2137] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:50:54 2022] DELETE /identity/v3/projects/6c5575303089477ba42e4ff6e6fe296c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:50:55.034912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.035419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.035528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.069979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:55.071726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:55.152308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1066/2138] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:50:55.160688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.161214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.161501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.184767 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:55.185925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:55.193847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1073/2139] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:55.199430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:55.210336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad72ca-3424-4444-8088-d0f806c1c939 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:55.215987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:55.216701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.217016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.217323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.218099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:50:55.218446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:55.246696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:55.263949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1067/2140] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:50:55.268294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:55.279352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b6ca1-3ad1-44aa-a874-e93008189d87 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:55.284398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:55.285011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.285298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.285578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.286221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:55.312779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:55.344267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1074/2141] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:50:55 2022] POST /identity/v3/projects => generated 397 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:55.348516 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:55.358665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392d086-b1d4-4e4f-b89c-74c12b0ffcb0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:55.423894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:55.424647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.425136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.425835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.426867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:55.457942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:55.480321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1068/2142] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:50:55 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:50:55.484145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:55.494032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf48e7-fb5b-4d36-a2f0-1877b954dbe6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:55.499623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701300a3-098b-4151-ae6d-547999534e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:55.500229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701300a3-098b-4151-ae6d-547999534e11 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.500517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701300a3-098b-4151-ae6d-547999534e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.500790 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701300a3-098b-4151-ae6d-547999534e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.501499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701300a3-098b-4151-ae6d-547999534e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:55.526833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701300a3-098b-4151-ae6d-547999534e11 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:55.539002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1075/2143] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:50:55.544472 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:55.554501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee6c2b-8046-4776-8c3e-cd59fd704603 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:55.559919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:55.560740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.561026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.561311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] PATH_INFO: `/v3/projects/3a029ffc7d814b16b48f2d6284474407/users/7453bc1341ed415597d6b12a36714562/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.585506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a029ffc7d814b16b48f2d6284474407, user_id=7453bc1341ed415597d6b12a36714562, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:55.613150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:55.627930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1069/2144] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:50:55 2022] PUT /identity/v3/projects/3a029ffc7d814b16b48f2d6284474407/users/7453bc1341ed415597d6b12a36714562/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:50:55.637136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.637439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.637714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.682755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] MFA Rules not processed for user `7453bc1341ed415597d6b12a36714562`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:50:55.684116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:55.765475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1076/2145] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3704 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:50:55.776313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:50:55.778066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:50:55.843362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58650e-15be-4234-bfe5-e27b15cb34e4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:50:55.846952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008bb45-7b6d-4643-853b-ad1d7769477a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:50:55.847543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008bb45-7b6d-4643-853b-ad1d7769477a service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:50:55.847818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008bb45-7b6d-4643-853b-ad1d7769477a service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:50:55.848092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008bb45-7b6d-4643-853b-ad1d7769477a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:50:55.856422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008bb45-7b6d-4643-853b-ad1d7769477a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:50:55.882345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008bb45-7b6d-4643-853b-ad1d7769477a service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:50:55.891883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1070/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:50:55 2022] GET /identity/v3/auth/tokens => generated 3704 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:05.631149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:05.766355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d560782-d9ce-4376-bcc4-029c38523193 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:05.772236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:05.773292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:05.773680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:05.774056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] PATH_INFO: `/v3/users/7453bc1341ed415597d6b12a36714562` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:05.775440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7453bc1341ed415597d6b12a36714562)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:05.825631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:05.927241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7453bc1341ed415597d6b12a36714562'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:05.949036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7453bc1341ed415597d6b12a36714562'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:05.949794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7453bc1341ed415597d6b12a36714562'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:05.968355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7453bc1341ed415597d6b12a36714562'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:05.982021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7453bc1341ed415597d6b12a36714562'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:05.992778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1077/2147] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:05 2022] DELETE /identity/v3/users/7453bc1341ed415597d6b12a36714562 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:05.994481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:05.995360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:05.995807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:06.021815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:06.023447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:06.098195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1071/2148] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:06.109174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:06.110528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:06.207167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce0f30-6177-4204-85b0-5be67e4b9b15 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:06.210538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:06.211169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:06.211591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:06.211882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:06.222073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:06.254494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:06.267946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1078/2149] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:06.980526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:06.994584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089d10b-6be3-4c4f-9877-73c1df2fc8b5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:07.002020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:07.002686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:07.002970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:07.003252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:07.007558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:07.138035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:07.170285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:07.181922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1072/2150] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3745 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:07.344016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:07.346351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:07.361411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac80c-f36a-4f50-be5a-f3092f4c3679 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:07.365935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:07.366775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:07.367098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:07.367375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] PATH_INFO: `/v3/projects/3a029ffc7d814b16b48f2d6284474407` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:07.368495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a029ffc7d814b16b48f2d6284474407)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:07.393996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:07.445618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a029ffc7d814b16b48f2d6284474407', 'request_id': 'req-f9bb028a-3e20-42f1-8878-adb24f6e7f44'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:07.451504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a029ffc7d814b16b48f2d6284474407', 'request_id': 'req-f9bb028a-3e20-42f1-8878-adb24f6e7f44'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:07.459949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a029ffc7d814b16b48f2d6284474407', 'request_id': 'req-f9bb028a-3e20-42f1-8878-adb24f6e7f44'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:07.476206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] The token cache is being invalidate because project 3a029ffc7d814b16b48f2d6284474407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:07.476495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:07.477103 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:07.478536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1079/2151] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:07 2022] DELETE /identity/v3/projects/3a029ffc7d814b16b48f2d6284474407 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:08.581704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:08.583358 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:08.596382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96b37-d581-451c-840e-01ea95bf4db5 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:08.661529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:08.662365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:08.662696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:08.662969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] PATH_INFO: `/v3/users/3821c97d9af346f9bd0213613abdfce4` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:08.664106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3821c97d9af346f9bd0213613abdfce4)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:08.690439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:08.740735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3821c97d9af346f9bd0213613abdfce4'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:08.749011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3821c97d9af346f9bd0213613abdfce4'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:08.757161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3821c97d9af346f9bd0213613abdfce4'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:08.757661 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3821c97d9af346f9bd0213613abdfce4'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:08.758299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3821c97d9af346f9bd0213613abdfce4'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:08.777972 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1073/2152] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:08 2022] DELETE /identity/v3/users/3821c97d9af346f9bd0213613abdfce4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:09.008386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:09.009944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:09.023062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb028a-3e20-42f1-8878-adb24f6e7f44 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:09.086081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:09.086913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:09.087467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:09.087467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] PATH_INFO: `/v3/projects/961d65354d6445ea9e56a757958f2cb7` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:09.088770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=961d65354d6445ea9e56a757958f2cb7)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:09.114086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:09.168110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961d65354d6445ea9e56a757958f2cb7', 'request_id': 'req-4b1879e2-44ea-4a61-b2d0-219e527ed95e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.174019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961d65354d6445ea9e56a757958f2cb7', 'request_id': 'req-4b1879e2-44ea-4a61-b2d0-219e527ed95e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.183698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961d65354d6445ea9e56a757958f2cb7', 'request_id': 'req-4b1879e2-44ea-4a61-b2d0-219e527ed95e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.204346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] The token cache is being invalidate because project 961d65354d6445ea9e56a757958f2cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:09.204711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.205397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.210232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1080/2153] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:09 2022] DELETE /identity/v3/projects/961d65354d6445ea9e56a757958f2cb7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:09.211368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:09.212865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:09.225951 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd32dbc-722f-40ea-abf2-88125195c662 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:09.295565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:09.296290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:09.296574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:09.296856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] PATH_INFO: `/v3/users/42e7289008a0459cb643cb67cfb91ad5` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:09.298059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e7289008a0459cb643cb67cfb91ad5)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:09.325194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:09.380478 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e7289008a0459cb643cb67cfb91ad5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.391460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e7289008a0459cb643cb67cfb91ad5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.402548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e7289008a0459cb643cb67cfb91ad5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.403239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e7289008a0459cb643cb67cfb91ad5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.403919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3f97e345-603e-408a-a8d2-b53a8e316732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e7289008a0459cb643cb67cfb91ad5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.422144 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1074/2154] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:09 2022] DELETE /identity/v3/users/42e7289008a0459cb643cb67cfb91ad5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:09.661162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:09.662506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:09.675774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1879e2-44ea-4a61-b2d0-219e527ed95e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:09.747396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:09.748203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:09.748484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:09.748759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] PATH_INFO: `/v3/projects/90676eb821f54150818a3fb70dc81db4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:09.749883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=90676eb821f54150818a3fb70dc81db4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:09.776499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:09.842751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90676eb821f54150818a3fb70dc81db4', 'request_id': 'req-8f97c272-2fa0-42b9-8513-522fe152c2ce'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.848730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90676eb821f54150818a3fb70dc81db4', 'request_id': 'req-8f97c272-2fa0-42b9-8513-522fe152c2ce'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.857691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90676eb821f54150818a3fb70dc81db4', 'request_id': 'req-8f97c272-2fa0-42b9-8513-522fe152c2ce'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.876250 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] The token cache is being invalidate because project 90676eb821f54150818a3fb70dc81db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:09.876775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.877464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-8f97c272-2fa0-42b9-8513-522fe152c2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:09.879287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1081/2155] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:09 2022] DELETE /identity/v3/projects/90676eb821f54150818a3fb70dc81db4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:09.883934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:09.884469 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:09.884755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:09.907421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:09.908733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:09.983023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1075/2156] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:09.994495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:09.995176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:09.995464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.026270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:10.027809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:10.040284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:10.040729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1082/2157] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:10.050492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696f2a9-33ac-4c6f-b425-4625dd77eac8 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:10.054959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:10.055561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.055966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.056253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.057008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:10.057498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:10.087709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:10.106664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1076/2158] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:51:10.109092 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:10.118598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b27f4a-7ba1-4c27-81cf-9750c4c965c0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:10.123559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:10.124296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.124581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.125034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.125709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:10.153554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:10.206935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1083/2159] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:10 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:10.211336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:10.222979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96805-dc88-467d-b586-7d66ebc01529 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:10.305590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:10.306316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.306704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.307163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.308050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:10.334432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:10.357971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1077/2160] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:10 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:10.361712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:10.374888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb767f-a72d-4487-a278-c03208d91681 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:10.379886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87a99d-9253-4a22-bab2-772dabb6ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:10.380481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a99d-9253-4a22-bab2-772dabb6ae11 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.380764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a99d-9253-4a22-bab2-772dabb6ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.381041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87a99d-9253-4a22-bab2-772dabb6ae11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.381732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a99d-9253-4a22-bab2-772dabb6ae11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:10.407339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87a99d-9253-4a22-bab2-772dabb6ae11 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:10.418824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1084/2161] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:10.422894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:10.432988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91eed1-f37a-43be-b6fc-b61d19fcd651 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:10.437306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:10.438441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.438753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.439032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] PATH_INFO: `/v3/projects/0e386d2117354e9683e6754aa9509d24/users/13e3b57e75774d23ac9e3399b0de4f5f/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.462122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e386d2117354e9683e6754aa9509d24, user_id=13e3b57e75774d23ac9e3399b0de4f5f, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:10.491771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:10.517624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1078/2162] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:10 2022] PUT /identity/v3/projects/0e386d2117354e9683e6754aa9509d24/users/13e3b57e75774d23ac9e3399b0de4f5f/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:10.519709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.520232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.520602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.567696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] MFA Rules not processed for user `13e3b57e75774d23ac9e3399b0de4f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:10.568992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:10.684205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1085/2163] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:10.690077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:10.691996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:10.844636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71814a-97d4-414d-bdf4-63dddaf8d78a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:10.848209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3caf8a53d924849b5cb756249a1a96f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:10.848809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:10.849156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:10.849440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:10.858698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:10.884760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:10.896010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1079/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:10 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:25.568029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:25.569560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:25.645291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0ad20-3508-4830-a78b-2257445a7751 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:25.650811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:25.651644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:25.652013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:25.652208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] PATH_INFO: `/v3/users/45a491cd7bb8422fb6e3ee727d7b15f7` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:25.653326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a491cd7bb8422fb6e3ee727d7b15f7)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:25.678695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:25.729934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a491cd7bb8422fb6e3ee727d7b15f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:25.739413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a491cd7bb8422fb6e3ee727d7b15f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:25.740135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a491cd7bb8422fb6e3ee727d7b15f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:25.752534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a491cd7bb8422fb6e3ee727d7b15f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:25.762520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c14779a3-70a1-4eb0-87f5-81aa695df444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a491cd7bb8422fb6e3ee727d7b15f7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:25.768490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1086/2165] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:25 2022] DELETE /identity/v3/users/45a491cd7bb8422fb6e3ee727d7b15f7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:26.092856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:26.103791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c23a9-4f10-488a-8cf1-1550a415cfe3 service glance] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:26.170058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:26.170887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.171175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.171448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] PATH_INFO: `/v3/projects/bbff699f8ada48a78f3957fe6718a4ad` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.172566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbff699f8ada48a78f3957fe6718a4ad)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:26.198340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:26.251914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbff699f8ada48a78f3957fe6718a4ad', 'request_id': 'req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:26.256935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbff699f8ada48a78f3957fe6718a4ad', 'request_id': 'req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:26.264881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbff699f8ada48a78f3957fe6718a4ad', 'request_id': 'req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:26.282795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] The token cache is being invalidate because project bbff699f8ada48a78f3957fe6718a4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:26.283077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:26.283697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0352f708-106f-4a0c-80bf-cb9ddc7dbc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:26.285112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1080/2166] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:26 2022] DELETE /identity/v3/projects/bbff699f8ada48a78f3957fe6718a4ad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:26.290283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.290835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.291151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.316113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:26.317243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:26.385955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1087/2167] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:26.394152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172016-f776-4100-bd42-452825c78a00 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.394445 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172016-f776-4100-bd42-452825c78a00 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.394759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65172016-f776-4100-bd42-452825c78a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.418175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-65172016-f776-4100-bd42-452825c78a00 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:26.419306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-65172016-f776-4100-bd42-452825c78a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:26.427743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1081/2168] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:26.432873 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:26.443464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06213b3d-d2c8-491c-a421-900feb0ff152 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:26.449655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:26.450754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.450754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.450754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.451196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:26.451468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:26.476502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:26.489725 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1088/2169] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:51:26.494173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172016-f776-4100-bd42-452825c78a00 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:26.504027 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65172016-f776-4100-bd42-452825c78a00 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:26.509167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:26.509751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.510036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.510313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.511000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:26.536584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:26.578616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1082/2170] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:26 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:26.582959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:26.596563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39623e-a130-4a8d-a70e-13bc3b53e281 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:26.665426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:26.666144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.666430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.666731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.667358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:26.693215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:26.716909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1089/2171] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:26 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:26.722529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:26.733305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd218eb-5664-41e0-a0f5-60e1bcab6764 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:26.737685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eeaa2-c8f1-4293-9c98-91fa06b1546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:26.738280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eeaa2-c8f1-4293-9c98-91fa06b1546d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.738574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eeaa2-c8f1-4293-9c98-91fa06b1546d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.738877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eeaa2-c8f1-4293-9c98-91fa06b1546d admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.739606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51eeaa2-c8f1-4293-9c98-91fa06b1546d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:26.765129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51eeaa2-c8f1-4293-9c98-91fa06b1546d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:26.775971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1083/2172] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:26.787441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:26.800720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af884bd-a430-4345-b1f6-f9a2fdb1e95d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:26.806730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:26.807552 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.807832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.808120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] PATH_INFO: `/v3/projects/65a8a0b637b144eab7a9339a6fc16f95/users/e772e46b1dbd4e8ca1b6aad2f1ddda6d/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.830753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a8a0b637b144eab7a9339a6fc16f95, user_id=e772e46b1dbd4e8ca1b6aad2f1ddda6d, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:26.857582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:26.873513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1090/2173] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:26 2022] PUT /identity/v3/projects/65a8a0b637b144eab7a9339a6fc16f95/users/e772e46b1dbd4e8ca1b6aad2f1ddda6d/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:26.883936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:26.884185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:26.884466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:26.922127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] MFA Rules not processed for user `e772e46b1dbd4e8ca1b6aad2f1ddda6d`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:26.923302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:26.995761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1084/2174] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:26 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:27.001862 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.073505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5ad7-1815-4f0f-8a7f-583e1faf76d7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.078268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.078898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.079185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.079443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.080109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.105528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.135077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1091/2175] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:27 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:27.136240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.147114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074d1e-b0aa-4c9e-81a5-cfdf8b18b660 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.216363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.217055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.217532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.217823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.218476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.247189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.270605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1085/2176] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:27 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:27.271967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.281824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3b223-f737-40ba-a322-82b5a122ff50 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.285984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.286603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.286895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.287175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.287874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.314079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.325945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1092/2177] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:27.330004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.340041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27a91d-4af9-41fb-b99c-c8f1df2adf63 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.344828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.345702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.345992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.346269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] PATH_INFO: `/v3/projects/1a6c2d62f4574faab8ff53725b57a3de/users/88996c28838f4ef4ae9f50b81a40c9cc/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.366850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c2d62f4574faab8ff53725b57a3de, user_id=88996c28838f4ef4ae9f50b81a40c9cc, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.392985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.408834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1086/2178] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:27 2022] PUT /identity/v3/projects/1a6c2d62f4574faab8ff53725b57a3de/users/88996c28838f4ef4ae9f50b81a40c9cc/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:27.415147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.425946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827a2c-db74-49a3-9a25-723ff79c3034 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.493530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.494125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.494410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.494719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.495440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.520927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.531516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1093/2179] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:51:27.535880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.546435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bb59-4f91-4792-ac3a-e4be7e256622 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.552217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.552910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.553169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.553464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] PATH_INFO: `/v3/projects/1a6c2d62f4574faab8ff53725b57a3de/users/88996c28838f4ef4ae9f50b81a40c9cc/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.555716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c2d62f4574faab8ff53725b57a3de, user_id=88996c28838f4ef4ae9f50b81a40c9cc, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.583770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.595459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1087/2180] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:27 2022] PUT /identity/v3/projects/1a6c2d62f4574faab8ff53725b57a3de/users/88996c28838f4ef4ae9f50b81a40c9cc/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:27.599609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.610074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a678-7da1-4513-a71a-2200feabb194 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.678975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27cd78-03f5-48b9-82a2-1166e6ccde35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.679572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27cd78-03f5-48b9-82a2-1166e6ccde35 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.679876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27cd78-03f5-48b9-82a2-1166e6ccde35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.680149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27cd78-03f5-48b9-82a2-1166e6ccde35 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.680838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27cd78-03f5-48b9-82a2-1166e6ccde35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.709579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27cd78-03f5-48b9-82a2-1166e6ccde35 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.723930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1094/2181] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:27.728193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.743462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94087d6-febb-4473-99cf-533a5077d782 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:27.749590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:27.750616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.750920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.751191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] PATH_INFO: `/v3/projects/1a6c2d62f4574faab8ff53725b57a3de/users/88996c28838f4ef4ae9f50b81a40c9cc/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.753031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6c2d62f4574faab8ff53725b57a3de, user_id=88996c28838f4ef4ae9f50b81a40c9cc, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:27.779943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:27.797180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1088/2182] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:27 2022] PUT /identity/v3/projects/1a6c2d62f4574faab8ff53725b57a3de/users/88996c28838f4ef4ae9f50b81a40c9cc/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:51:27.807157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:27.807460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:27.807745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:27.852226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] MFA Rules not processed for user `88996c28838f4ef4ae9f50b81a40c9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:27.853425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:27.933900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1095/2183] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:27 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:27.944510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:27.946319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:28.019408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b1539-54a4-4ae3-a36a-2241c80899b4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:28.022952 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:28.023529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:28.023815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:28.024090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:28.033390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:28.058590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:28.068967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1089/2184] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:27 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:28.172222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:28.181652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22598a82-a373-440d-b8f7-d49c6f93da0f None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:28.185193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:28.185875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:28.186285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:28.186722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:28.251381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:28.277232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:28.287195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1096/2185] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:28 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:51:38.733665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:38.735174 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:38.867929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbc68f-4f43-4a68-ac5c-9bba9c6cde45 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:38.873989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:38.874880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:38.875347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:38.875640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] PATH_INFO: `/v3/users/f038a4a281c04d9b9b81caa376c2db71` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:38.876749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f038a4a281c04d9b9b81caa376c2db71)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:38.910403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:38.969829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f038a4a281c04d9b9b81caa376c2db71'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:38.979217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f038a4a281c04d9b9b81caa376c2db71'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:38.988912 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f038a4a281c04d9b9b81caa376c2db71'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:38.989574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f038a4a281c04d9b9b81caa376c2db71'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:38.990292 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-069765b0-f23a-4574-8746-a002667f9ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f038a4a281c04d9b9b81caa376c2db71'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:39.014626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1090/2186] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:38 2022] DELETE /identity/v3/users/f038a4a281c04d9b9b81caa376c2db71 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:39.448762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:39.463577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d903e-c973-4b10-a0b8-419a040c04c7 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:39.544992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:39.546246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:39.546699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:39.547101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] PATH_INFO: `/v3/projects/2dde676ebfae458485b906516863f0a6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:39.548683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dde676ebfae458485b906516863f0a6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:39.585485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:39.642509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dde676ebfae458485b906516863f0a6', 'request_id': 'req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:39.648546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dde676ebfae458485b906516863f0a6', 'request_id': 'req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:39.656748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dde676ebfae458485b906516863f0a6', 'request_id': 'req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:39.673868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] The token cache is being invalidate because project 2dde676ebfae458485b906516863f0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:39.674202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:39.674870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-7e95441f-8d0e-48a5-b68d-8f2d7897ba14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:39.677130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1097/2187] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:39 2022] DELETE /identity/v3/projects/2dde676ebfae458485b906516863f0a6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:39.682161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:39.682449 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:39.683287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:39.725781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:39.727306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:39.831000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1091/2188] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:39.838959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:39.839310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:39.839600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:39.888703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:39.890296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:39.898998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1098/2189] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:39.903203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:39.916801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962be8-f2d0-4af7-aa2e-3baab4d64cb2 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:39.922161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:39.923009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:39.923408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:39.924119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:39.924941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:39.925314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:39.961548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:39.977384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1092/2190] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:51:39.981416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:39.990187 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f62c-f3f3-4e23-8ec2-dcc5d26a110b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:39.994630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:39.995336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:39.995770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:39.996055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:39.996719 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:40.023288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:40.070620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1099/2191] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:39 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:40.070787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:40.081619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2260aaf-9f14-426b-8acb-e0c4d3bd1e6a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:40.236505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:40.237556 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:40.237992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:40.238407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:40.239241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:40.297384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:40.377372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:40.382974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1093/2192] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:40 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:51:40.397261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985d7c-f7b5-46a9-ae32-a6c52d7416c4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:40.402946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4485695-ebfb-44dd-b267-6b72065ba249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:40.403665 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485695-ebfb-44dd-b267-6b72065ba249 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:40.404067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485695-ebfb-44dd-b267-6b72065ba249 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:40.404448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4485695-ebfb-44dd-b267-6b72065ba249 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:40.405277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485695-ebfb-44dd-b267-6b72065ba249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:40.439237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4485695-ebfb-44dd-b267-6b72065ba249 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:40.455867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:40.456084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1100/2193] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:51:40.473619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32037177-778f-4f81-8fdb-a9b18aacc896 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:40.482983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:40.484185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:40.484672 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:40.485136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] PATH_INFO: `/v3/projects/8df718e609f94677adfb6b738e380660/users/5637aac3235f42109655163d5d05c354/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:40.535098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df718e609f94677adfb6b738e380660, user_id=5637aac3235f42109655163d5d05c354, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:40.595422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:40.617256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1094/2194] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:40 2022] PUT /identity/v3/projects/8df718e609f94677adfb6b738e380660/users/5637aac3235f42109655163d5d05c354/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:40.623220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7ad8-2ca3-4d98-8e80-2b173ef3a8f9 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:40.623514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7ad8-2ca3-4d98-8e80-2b173ef3a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:40.623796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7ad8-2ca3-4d98-8e80-2b173ef3a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:40.659848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-02fb7ad8-2ca3-4d98-8e80-2b173ef3a8f9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:40.661325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-02fb7ad8-2ca3-4d98-8e80-2b173ef3a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:40.793791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1101/2195] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:40.807375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:40.809566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:40.911819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d02641-ff1a-4a9d-9abb-746d29ef66c7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:40.917434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:40.918248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:40.918541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:40.918899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:40.931609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:40.959299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:40.970763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1095/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:41.114932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90505f5b-90d2-4ad0-9602-054287e10afb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:41.116240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90505f5b-90d2-4ad0-9602-054287e10afb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:41.116821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90505f5b-90d2-4ad0-9602-054287e10afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:41.144874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-90505f5b-90d2-4ad0-9602-054287e10afb None None] MFA Rules not processed for user `6b707673c1614cb59683ffa0810cc6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:41.146410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-90505f5b-90d2-4ad0-9602-054287e10afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:41.250245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1102/2197] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:41.895431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:41.896801 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:41.910847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce531-72dd-4718-8bd7-01b13622af08 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:41.916311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:41.918031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:41.918642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:41.919143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] PATH_INFO: `/v3/users/13e3b57e75774d23ac9e3399b0de4f5f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:41.920515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e3b57e75774d23ac9e3399b0de4f5f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:41.982191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:42.035273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.039079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.039646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.095107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e3b57e75774d23ac9e3399b0de4f5f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:42.112383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e3b57e75774d23ac9e3399b0de4f5f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:42.124299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] MFA Rules not processed for user `5637aac3235f42109655163d5d05c354`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:42.125433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e3b57e75774d23ac9e3399b0de4f5f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:42.129724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:42.130289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e3b57e75774d23ac9e3399b0de4f5f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:42.131326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ffc3974e-60d3-437a-8754-52618f9268aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e3b57e75774d23ac9e3399b0de4f5f'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:42.166370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1096/2198] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:41 2022] DELETE /identity/v3/users/13e3b57e75774d23ac9e3399b0de4f5f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:42.172702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.172992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.173303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.222761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:42.227562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:42.275437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1103/2199] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:42.276795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:42.278666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:42.298676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92281074-f6a9-42f3-bb97-fce6ef05ffba None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:42.386438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1097/2200] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:42.396957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:42.398375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:42.411935 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:42.412953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.413482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.414098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.415003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:42.453024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:42.509272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1104/2201] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:42 2022] POST /identity/v3/projects => generated 403 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:42.510337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:42.519809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f8b5-2b5c-494b-bd75-ed4d79d3bfed None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:42.633171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:42.633764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.634106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.634333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.658916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f629e-b1fc-41ae-a5ed-50645fafbda9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:42.659126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:42.664518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:42.665540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.665852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.666386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.667494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:42.700423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:42.715572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:42.740235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1098/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:51:42.745729 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1105/2203] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:42 2022] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:42.746893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:42.756336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4b487-baf9-4b48-8568-b08738f90eff service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:42.761387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:42.761692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.761976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.762253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.763012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:42.789339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:42.802597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1099/2204] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:42.804247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:42.817131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d13456-91f4-486a-85fe-d7aa1d9ef5c7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:42.822475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:42.823886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.824294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.824667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] PATH_INFO: `/v3/projects/10b55ca8904a4b26aa850ae668df3042/users/b2f088ed5a094e8c9dbff688938ef44c/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.850312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b55ca8904a4b26aa850ae668df3042, user_id=b2f088ed5a094e8c9dbff688938ef44c, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:42.880727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:42.897819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1106/2205] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:42 2022] PUT /identity/v3/projects/10b55ca8904a4b26aa850ae668df3042/users/b2f088ed5a094e8c9dbff688938ef44c/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:42.902595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:42.912342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db966b25-8a3b-4b82-b609-86b5e74f94a5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:42.989339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:42.990643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:42.991122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:42.991583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:42.992295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:43.020677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:43.035253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1100/2206] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:43.036741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:43.047919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935193-448f-487e-9017-6511f5b2b4da admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:43.053440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:43.054425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:43.054797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:43.055174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] PATH_INFO: `/v3/projects/10b55ca8904a4b26aa850ae668df3042/users/b2f088ed5a094e8c9dbff688938ef44c/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:43.057177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b55ca8904a4b26aa850ae668df3042, user_id=b2f088ed5a094e8c9dbff688938ef44c, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:43.085135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:43.097385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1107/2207] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:43 2022] PUT /identity/v3/projects/10b55ca8904a4b26aa850ae668df3042/users/b2f088ed5a094e8c9dbff688938ef44c/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:43.101331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:43.117322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf700da-c980-4879-a753-2dc790ebe4a8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:43.234104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:43.235043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:43.235484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:43.235947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:43.236812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:43.263157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:43.273991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1101/2208] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:43.278688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:43.288757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c066e-5769-46aa-b7af-66c350d6d8bf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:43.293179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95328714-7351-4a9a-ab01-0da0cb4870c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:43.294002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95328714-7351-4a9a-ab01-0da0cb4870c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:43.294290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95328714-7351-4a9a-ab01-0da0cb4870c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:43.294595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95328714-7351-4a9a-ab01-0da0cb4870c9 admin admin] PATH_INFO: `/v3/projects/10b55ca8904a4b26aa850ae668df3042/users/b2f088ed5a094e8c9dbff688938ef44c/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:43.296387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95328714-7351-4a9a-ab01-0da0cb4870c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b55ca8904a4b26aa850ae668df3042, user_id=b2f088ed5a094e8c9dbff688938ef44c, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:43.323296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95328714-7351-4a9a-ab01-0da0cb4870c9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:43.342015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1108/2209] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:43 2022] PUT /identity/v3/projects/10b55ca8904a4b26aa850ae668df3042/users/b2f088ed5a094e8c9dbff688938ef44c/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:51:43.996274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:44.002508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:44.027828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6701e-6ff7-405b-babf-df370a7616fa admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:44.109692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:44.111106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.111547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.112645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] PATH_INFO: `/v3/projects/0e386d2117354e9683e6754aa9509d24` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.114696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e386d2117354e9683e6754aa9509d24)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:44.149919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:44.270484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e386d2117354e9683e6754aa9509d24', 'request_id': 'req-9468a261-e28d-4930-ab28-f7a91d83fa36'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:44.276038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e386d2117354e9683e6754aa9509d24', 'request_id': 'req-9468a261-e28d-4930-ab28-f7a91d83fa36'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:44.288895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e386d2117354e9683e6754aa9509d24', 'request_id': 'req-9468a261-e28d-4930-ab28-f7a91d83fa36'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:44.310949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] The token cache is being invalidate because project 0e386d2117354e9683e6754aa9509d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:44.311957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:44.313054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9468a261-e28d-4930-ab28-f7a91d83fa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:44.315364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1102/2210] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:43 2022] DELETE /identity/v3/projects/0e386d2117354e9683e6754aa9509d24 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:44.321058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.321895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.322317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.346721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:44.348384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:44.422626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1109/2211] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:44.430463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.431055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.431494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.455550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:44.456933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:44.469948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1103/2212] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:44.475766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:44.494154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12bbc8-4d29-4d41-a28d-7c9f7d840897 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:44.499613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:44.500478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.500977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.501469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.502325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:44.502726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:44.530010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:44.554270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1110/2213] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:51:44.555991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:44.565285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4677e8e-03ae-421a-afca-1b2d5b6cb709 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:44.569854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:44.570529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.570916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.571270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.572616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:44.599881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:44.631753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1104/2214] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:44 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:44.635969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:44.646271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d59bc8-1d3f-4af1-b9b5-c06fbe06b6c1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:44.721238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9fb36-3b4a-46c5-8759-8ee146c8d3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:44.722041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9fb36-3b4a-46c5-8759-8ee146c8d3ff admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.722388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9fb36-3b4a-46c5-8759-8ee146c8d3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.722778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9fb36-3b4a-46c5-8759-8ee146c8d3ff admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.723522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9fb36-3b4a-46c5-8759-8ee146c8d3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:44.749658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9fb36-3b4a-46c5-8759-8ee146c8d3ff admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:44.772335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1111/2215] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:44 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:51:44.776784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:44.787761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc1c5b-6add-4e03-a1c3-94b1674cd111 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:44.793998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:44.794768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.795152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.795555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.797285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:44.849961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:44.859744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.860319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.860753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.876536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1105/2216] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:44.880751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:44.891947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3b473-91ce-4d17-9045-529071e0639d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:44.896797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7769b9-f741-49fc-bca5-8341f4809e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:44.897696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7769b9-f741-49fc-bca5-8341f4809e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:44.898056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7769b9-f741-49fc-bca5-8341f4809e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:44.898408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7769b9-f741-49fc-bca5-8341f4809e13 admin admin] PATH_INFO: `/v3/projects/3e4d231c0cb9427ea1db5986f6af3929/users/879264cb35e9400f9c2378698ffd533f/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:44.923905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7769b9-f741-49fc-bca5-8341f4809e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4d231c0cb9427ea1db5986f6af3929, user_id=879264cb35e9400f9c2378698ffd533f, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:44.981640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7769b9-f741-49fc-bca5-8341f4809e13 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:45.004844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1106/2217] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:44 2022] PUT /identity/v3/projects/3e4d231c0cb9427ea1db5986f6af3929/users/879264cb35e9400f9c2378698ffd533f/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:51:45.016055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95694e-e8d2-4615-82ee-6d7bd1af0f73 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:45.016431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95694e-e8d2-4615-82ee-6d7bd1af0f73 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:45.016787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95694e-e8d2-4615-82ee-6d7bd1af0f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:45.070488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] MFA Rules not processed for user `b2f088ed5a094e8c9dbff688938ef44c`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:45.072003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:45.103874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-4f95694e-e8d2-4615-82ee-6d7bd1af0f73 None None] MFA Rules not processed for user `879264cb35e9400f9c2378698ffd533f`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:45.108243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4f95694e-e8d2-4615-82ee-6d7bd1af0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:45.180460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1112/2218] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3777 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:45.253985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1107/2219] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:45.264143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:45.270627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:45.404671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecf91e-3717-44df-883d-c9e9930f90d3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:45.415513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f494483-a3ea-4d6d-82c4-ea45fb307a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:45.416748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494483-a3ea-4d6d-82c4-ea45fb307a30 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:45.416748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494483-a3ea-4d6d-82c4-ea45fb307a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:45.417300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f494483-a3ea-4d6d-82c4-ea45fb307a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:45.434156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f494483-a3ea-4d6d-82c4-ea45fb307a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:45.492122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f494483-a3ea-4d6d-82c4-ea45fb307a30 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:45.525551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1113/2220] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:45 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:46.989403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:46.989895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:46.990121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:47.015530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] MFA Rules not processed for user `b29711f9ca2e4725b4f702405eb31bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:47.016691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:47.085209 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1108/2221] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:47.318379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:47.318952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:47.318952 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:47.349150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] MFA Rules not processed for user `879264cb35e9400f9c2378698ffd533f`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:47.351612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:47.359868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1114/2222] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:48.065904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:48.067520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:48.157350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5369d37-d1f7-482f-bafd-4bc57674f3ea None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:48.162377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:48.163324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:48.163767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:48.164302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] PATH_INFO: `/v3/users/5637aac3235f42109655163d5d05c354` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:48.165436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5637aac3235f42109655163d5d05c354)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:48.193308 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:48.255581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5637aac3235f42109655163d5d05c354'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:48.264953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5637aac3235f42109655163d5d05c354'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:48.276026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5637aac3235f42109655163d5d05c354'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:48.276979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5637aac3235f42109655163d5d05c354'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:48.278939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5637aac3235f42109655163d5d05c354'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:48.306918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1109/2223] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:48 2022] DELETE /identity/v3/users/5637aac3235f42109655163d5d05c354 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:48.778901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:48.791171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9da8-ed85-4f25-8f91-b62b88f0105b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:48.917332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:48.918282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:48.918591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:48.919069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] PATH_INFO: `/v3/projects/8df718e609f94677adfb6b738e380660` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:48.920624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df718e609f94677adfb6b738e380660)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:48.953154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:49.021057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df718e609f94677adfb6b738e380660', 'request_id': 'req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.028531 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df718e609f94677adfb6b738e380660', 'request_id': 'req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.053650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df718e609f94677adfb6b738e380660', 'request_id': 'req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.086923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] The token cache is being invalidate because project 8df718e609f94677adfb6b738e380660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:49.087407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.088362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.102127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:49.104698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:49.108884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1115/2224] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:48 2022] DELETE /identity/v3/projects/8df718e609f94677adfb6b738e380660 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:49.143154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a17bae-2ec8-45b2-8f1d-f89f7f373441 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:49.268113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:49.273937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:49.275465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:49.275465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] PATH_INFO: `/v3/users/b2f088ed5a094e8c9dbff688938ef44c` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:49.280173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f088ed5a094e8c9dbff688938ef44c)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:49.332023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:49.414450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f088ed5a094e8c9dbff688938ef44c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.422642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f088ed5a094e8c9dbff688938ef44c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.431678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f088ed5a094e8c9dbff688938ef44c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.432429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f088ed5a094e8c9dbff688938ef44c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.433141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6cb7caa1-574e-4d41-9681-f2077f874104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f088ed5a094e8c9dbff688938ef44c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.453458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1110/2225] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:49 2022] DELETE /identity/v3/users/b2f088ed5a094e8c9dbff688938ef44c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:51:49.686544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:49.687984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:49.704604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a2062-1a65-4510-b943-02ac7c1e5fb6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:49.772046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:49.772850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:49.773128 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:49.773398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] PATH_INFO: `/v3/projects/10b55ca8904a4b26aa850ae668df3042` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:49.774490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b55ca8904a4b26aa850ae668df3042)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:49.803897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:49.865064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b55ca8904a4b26aa850ae668df3042', 'request_id': 'req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.871824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b55ca8904a4b26aa850ae668df3042', 'request_id': 'req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.884510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b55ca8904a4b26aa850ae668df3042', 'request_id': 'req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.910702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] The token cache is being invalidate because project 10b55ca8904a4b26aa850ae668df3042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:49.911155 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.913075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2de2f0b9-4308-4e17-ba0c-7329a36f89b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:49.915343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1116/2226] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:49 2022] DELETE /identity/v3/projects/10b55ca8904a4b26aa850ae668df3042 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:49.920849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:49.921465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:49.922004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:49.955436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:49.957187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:50.077230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1111/2227] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:50.080274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.080579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.081153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.103820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:50.105492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:50.114381 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1117/2228] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:50.118595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.128487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7effac-2a8e-4788-8aa5-52ef73a8d84d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:50.132750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:50.133350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.133633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.133904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.134812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:50.135370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:50.161864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:50.180272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1112/2229] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:51:50.185157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.195104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562fa9c-0e53-492d-b64b-b96d4da0a855 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:50.200785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:50.201610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.202096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.202577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.203397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:50.243345 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:50.280022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1118/2230] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:50 2022] POST /identity/v3/projects => generated 361 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:51:50.283949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.293857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df18db1-16ff-4299-bbff-f716e05be809 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:50.363290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:50.363994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.364372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.364660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.365298 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:50.393828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:50.420628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1113/2231] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:50 2022] POST /identity/v3/users => generated 281 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:50.422361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.436448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fd69-61f6-483f-930c-b2ab530d83c7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:50.441214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1dca-f2ff-431c-b927-5644449a0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:50.441860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1dca-f2ff-431c-b927-5644449a0670 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.442156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1dca-f2ff-431c-b927-5644449a0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.442437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1dca-f2ff-431c-b927-5644449a0670 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.443207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f1dca-f2ff-431c-b927-5644449a0670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:50.472136 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f1dca-f2ff-431c-b927-5644449a0670 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:50.486591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1119/2232] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:51:50.487482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.498601 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794a66e-c6f4-4c2e-9b01-b2f72f47f24e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:50.508821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:50.510146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.510859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.511388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] PATH_INFO: `/v3/projects/b598b9993802425ea73a1b9db734e370/users/893a98acd7e14d3c95acec49c886aafb/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.543559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b598b9993802425ea73a1b9db734e370, user_id=893a98acd7e14d3c95acec49c886aafb, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:50.571730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:50.592225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1114/2233] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:50 2022] PUT /identity/v3/projects/b598b9993802425ea73a1b9db734e370/users/893a98acd7e14d3c95acec49c886aafb/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:50.603221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.603678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.604169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.654412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] MFA Rules not processed for user `893a98acd7e14d3c95acec49c886aafb`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:50.656168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:50.762441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1120/2234] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3668 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:50.771686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.843985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d638017-db16-4c94-8598-0c337591edb1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:50.848468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:50.849143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:50.849501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:50.849838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:50.850581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:50.876850 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:50.913376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1115/2235] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:50 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:50.917612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:50.928771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b68eb0-906b-4b81-9b12-f4929ebcf0dc None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.005315 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.005906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.006193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.006471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.007167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.033404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.057394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1121/2236] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:50 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:51:51.058677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.069535 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f3fe-f1c2-4df1-8831-38110e8d3d8f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.074685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.075539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.075832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.076113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.076814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.103819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.116102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1116/2237] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:51:51.120283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.131226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25037e3e-efb4-4fab-90a9-51b8fe5c8563 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.136514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.137676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.138000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.138330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] PATH_INFO: `/v3/projects/7b81d8de956042f491e12e9d9ee3d292/users/e170d30c6ddb451aa23c2078aa04d0dd/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.160075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b81d8de956042f491e12e9d9ee3d292, user_id=e170d30c6ddb451aa23c2078aa04d0dd, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.198240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.212289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1122/2238] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:51 2022] PUT /identity/v3/projects/7b81d8de956042f491e12e9d9ee3d292/users/e170d30c6ddb451aa23c2078aa04d0dd/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:51.216509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.228706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb366d2-1ed0-41a4-8860-e10160732a0b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.298539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.299375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.299736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.300084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.300879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.326907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.337615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1117/2239] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:51.342385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.352507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec768a1-3187-4959-ae73-fbeac8faf20b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.357715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.359320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.359886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.360175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] PATH_INFO: `/v3/projects/7b81d8de956042f491e12e9d9ee3d292/users/e170d30c6ddb451aa23c2078aa04d0dd/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.362476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b81d8de956042f491e12e9d9ee3d292, user_id=e170d30c6ddb451aa23c2078aa04d0dd, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.389658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.400367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1123/2240] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:51 2022] PUT /identity/v3/projects/7b81d8de956042f491e12e9d9ee3d292/users/e170d30c6ddb451aa23c2078aa04d0dd/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:51:51.404764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.414880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e857d-0b92-48c5-a98c-d88dea21f009 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.482277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f82853-27f8-4b57-92f0-eb48bb005a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.482917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f82853-27f8-4b57-92f0-eb48bb005a0c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.483202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f82853-27f8-4b57-92f0-eb48bb005a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.483480 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f82853-27f8-4b57-92f0-eb48bb005a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.484172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f82853-27f8-4b57-92f0-eb48bb005a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.509759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f82853-27f8-4b57-92f0-eb48bb005a0c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.520906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1118/2241] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:51.525230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.535746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a6b8f-8000-46d8-8f4f-6b0a14f64864 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.540126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.540944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.541221 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.541544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] PATH_INFO: `/v3/projects/7b81d8de956042f491e12e9d9ee3d292/users/e170d30c6ddb451aa23c2078aa04d0dd/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.543980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b81d8de956042f491e12e9d9ee3d292, user_id=e170d30c6ddb451aa23c2078aa04d0dd, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.571871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.588325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1124/2242] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:51 2022] PUT /identity/v3/projects/7b81d8de956042f491e12e9d9ee3d292/users/e170d30c6ddb451aa23c2078aa04d0dd/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:51.600042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf0218-3509-435c-952a-5c6942550504 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.600330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf0218-3509-435c-952a-5c6942550504 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.600632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf0218-3509-435c-952a-5c6942550504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.639701 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-54cf0218-3509-435c-952a-5c6942550504 None None] MFA Rules not processed for user `e170d30c6ddb451aa23c2078aa04d0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:51.641051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-54cf0218-3509-435c-952a-5c6942550504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:51.727686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1119/2243] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:51.739213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:51.740883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:51.819575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cfd6-2e31-40ec-9755-666bcd5f61df admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:51.825625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a11a-2cb1-4e64-b780-687063aed47f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:51.826368 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a11a-2cb1-4e64-b780-687063aed47f service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:51.826687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a11a-2cb1-4e64-b780-687063aed47f service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:51.826968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a11a-2cb1-4e64-b780-687063aed47f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:51.837252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a11a-2cb1-4e64-b780-687063aed47f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:51.865829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a11a-2cb1-4e64-b780-687063aed47f service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:51.892972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1125/2244] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:51 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:52.223415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf0218-3509-435c-952a-5c6942550504 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:52.324230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf0218-3509-435c-952a-5c6942550504 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:52.329875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:52.331466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:52.331938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:52.332385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] PATH_INFO: `/v3/users/893a98acd7e14d3c95acec49c886aafb` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:52.333827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=893a98acd7e14d3c95acec49c886aafb)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:52.361620 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:52.421431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893a98acd7e14d3c95acec49c886aafb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:52.430966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893a98acd7e14d3c95acec49c886aafb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:52.443018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893a98acd7e14d3c95acec49c886aafb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:52.444192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893a98acd7e14d3c95acec49c886aafb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:52.445260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893a98acd7e14d3c95acec49c886aafb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:52.474406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1120/2245] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:52 2022] DELETE /identity/v3/users/893a98acd7e14d3c95acec49c886aafb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:52.478965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:52.480215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:52.480675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:52.546056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:52.548038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:52.643200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1126/2246] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:52.652242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:52.653734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:52.742221 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b0427-3994-4f8e-a4a1-eab64500f77e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:52.746006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:52.746717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:52.747001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:52.747274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:52.759214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:52.788388 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:52.799208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1121/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:53.300435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:53.303638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:53.335288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03efd5-c583-4b5f-8412-7cc12d237e69 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:53.346909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:53.347792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:53.349236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:53.349536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] PATH_INFO: `/v3/projects/b598b9993802425ea73a1b9db734e370` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:53.352422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b598b9993802425ea73a1b9db734e370)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:53.384606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:53.442519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b598b9993802425ea73a1b9db734e370', 'request_id': 'req-880e0202-c58d-48ec-8e2a-6a68b102b36e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.448152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b598b9993802425ea73a1b9db734e370', 'request_id': 'req-880e0202-c58d-48ec-8e2a-6a68b102b36e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.462197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b598b9993802425ea73a1b9db734e370', 'request_id': 'req-880e0202-c58d-48ec-8e2a-6a68b102b36e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.485803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] The token cache is being invalidate because project b598b9993802425ea73a1b9db734e370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:53.486763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.487570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.489829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1127/2248] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:53 2022] DELETE /identity/v3/projects/b598b9993802425ea73a1b9db734e370 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:53.493686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:53.503569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e400b-2928-4ae0-9857-4aa12ea25444 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:53.584882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:53.585823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:53.586116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:53.586402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] PATH_INFO: `/v3/users/e170d30c6ddb451aa23c2078aa04d0dd` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:53.587979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e170d30c6ddb451aa23c2078aa04d0dd)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:53.614616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:53.696008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e170d30c6ddb451aa23c2078aa04d0dd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.713455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e170d30c6ddb451aa23c2078aa04d0dd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.733878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e170d30c6ddb451aa23c2078aa04d0dd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.734719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e170d30c6ddb451aa23c2078aa04d0dd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.735387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-cadb2d91-a679-4733-b0d8-13a959cb4a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e170d30c6ddb451aa23c2078aa04d0dd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:53.771507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1122/2249] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:53 2022] DELETE /identity/v3/users/e170d30c6ddb451aa23c2078aa04d0dd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:54.201044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:54.203210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:54.221936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e0202-c58d-48ec-8e2a-6a68b102b36e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:54.309219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:54.310046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:54.310392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:54.310728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] PATH_INFO: `/v3/projects/7b81d8de956042f491e12e9d9ee3d292` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:54.312591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b81d8de956042f491e12e9d9ee3d292)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:54.343591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:54.410592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b81d8de956042f491e12e9d9ee3d292', 'request_id': 'req-92a3b1f4-1bd3-4c78-ac56-be6098da9420'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:54.420175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b81d8de956042f491e12e9d9ee3d292', 'request_id': 'req-92a3b1f4-1bd3-4c78-ac56-be6098da9420'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:54.429132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b81d8de956042f491e12e9d9ee3d292', 'request_id': 'req-92a3b1f4-1bd3-4c78-ac56-be6098da9420'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:54.445943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] The token cache is being invalidate because project 7b81d8de956042f491e12e9d9ee3d292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:54.446487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:54.447145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-92a3b1f4-1bd3-4c78-ac56-be6098da9420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:54.449077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1128/2250] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:54 2022] DELETE /identity/v3/projects/7b81d8de956042f491e12e9d9ee3d292 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:54.453866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:54.454168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:54.454453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:54.479319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:54.480483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:54.686787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1123/2251] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:54.695565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:54.696030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:54.696270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:54.738911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:54.741335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:54.763448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1129/2252] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:54.764467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:54.779512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8489c3-adaf-46ff-afa9-22deabba1bc1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:54.786278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:54.787175 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:54.789384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:54.789929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:54.791111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:54.792041 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:54.830366 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:54.852589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1124/2253] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:51:54.854063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:54.866994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cb4e8-1f89-4ad9-813d-ecdf5f0f47c3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:54.877403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:54.878375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:54.878883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:54.879339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:54.880209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:54.937267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:54.976388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1130/2254] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:54 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:54.982468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.002884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b8202-6030-490c-a193-233c9b9f72f8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.083914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.085190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.086021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.086669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.087652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.125467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.149618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1125/2255] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:54 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:55.153510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.164479 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d7ca1-e55a-4add-9761-d1e10096c3c1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.170469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e700bd3-5d07-4bbf-9733-570d403f03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.171397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e700bd3-5d07-4bbf-9733-570d403f03c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.171930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e700bd3-5d07-4bbf-9733-570d403f03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.172499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e700bd3-5d07-4bbf-9733-570d403f03c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.173553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e700bd3-5d07-4bbf-9733-570d403f03c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.203133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e700bd3-5d07-4bbf-9733-570d403f03c6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.228171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1131/2256] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:51:55.232385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.250150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a143316-6795-4115-ade1-349b3180fed1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.256208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.257129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.257486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.257838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] PATH_INFO: `/v3/projects/0b4af6ba490e474a950bbac98ab914e3/users/2956ee49c3354ad187a9f9bef7ceac66/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.293315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4af6ba490e474a950bbac98ab914e3, user_id=2956ee49c3354ad187a9f9bef7ceac66, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.321591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.336138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1126/2257] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:55 2022] PUT /identity/v3/projects/0b4af6ba490e474a950bbac98ab914e3/users/2956ee49c3354ad187a9f9bef7ceac66/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:55.346376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.346718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.346997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.385750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] MFA Rules not processed for user `2956ee49c3354ad187a9f9bef7ceac66`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:55.387053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:55.460941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1132/2258] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:51:55.465804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.537018 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216c73f-b662-42f1-b1f5-38cf01697a0e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.542415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.543315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.543762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.544199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.544999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.574029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.611430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1127/2259] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:55 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:51:55.615435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.627526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594239e-78a1-42f8-acff-ddbc82ad1091 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.694438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.695254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.695540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.695813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.696447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.722071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.746375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1133/2260] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:55 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:51:55.750802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.761231 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8879-6099-444b-9adf-1646f882a4ea admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.766581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.767205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.767927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.767927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.768639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.794740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.806680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1128/2261] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:55.811495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.821346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbd45f-6b08-4e06-aa82-5b9dd853f23a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.827296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.828059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.828346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.828613 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] PATH_INFO: `/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a/users/6ff98f28745d455b96ef7ede35795199/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.849397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfa1b3d22804b92a55adf9d4bda635a, user_id=6ff98f28745d455b96ef7ede35795199, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:55.876432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:55.892032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1134/2262] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:55 2022] PUT /identity/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a/users/6ff98f28745d455b96ef7ede35795199/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:55.896145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:55.906909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528db1b-5590-4144-9d33-9cbd066af582 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:55.976497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:55.977119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:55.977443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:55.977678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:55.978377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:56.011804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:56.030368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1129/2263] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:51:56.031695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:56.043611 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ca0bc-ce37-4f94-b1c2-7eb4d43e8abe admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:56.049468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:56.050404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.050832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.051334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] PATH_INFO: `/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a/users/6ff98f28745d455b96ef7ede35795199/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.053338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfa1b3d22804b92a55adf9d4bda635a, user_id=6ff98f28745d455b96ef7ede35795199, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:56.083646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:56.095597 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1135/2264] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:56 2022] PUT /identity/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a/users/6ff98f28745d455b96ef7ede35795199/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:56.099537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:56.110145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ed14b-febd-4dd1-8105-aafc17c103db admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:56.205095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf6f7-00fe-4556-8ca5-1cfc66d38a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:56.205716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf6f7-00fe-4556-8ca5-1cfc66d38a3d admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.206004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf6f7-00fe-4556-8ca5-1cfc66d38a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.206285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf6f7-00fe-4556-8ca5-1cfc66d38a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.207033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccf6f7-00fe-4556-8ca5-1cfc66d38a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:56.233968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccf6f7-00fe-4556-8ca5-1cfc66d38a3d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:56.246595 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1130/2265] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:56.250651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:56.261750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d744f63-2634-460b-a1e1-f9b76a115f6c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:56.266870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:56.267875 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.268361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.268809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] PATH_INFO: `/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a/users/6ff98f28745d455b96ef7ede35795199/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.270900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfa1b3d22804b92a55adf9d4bda635a, user_id=6ff98f28745d455b96ef7ede35795199, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:56.300121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:56.334676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1136/2266] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:56 2022] PUT /identity/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a/users/6ff98f28745d455b96ef7ede35795199/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:56.337856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.338450 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.338757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.383962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] MFA Rules not processed for user `6ff98f28745d455b96ef7ede35795199`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:56.385371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:56.478710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1131/2267] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:56.491056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:56.492520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:56.568781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f577-0936-464c-9b99-5053977e0226 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:56.574079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c80e4-b3ca-4c0d-bc07-09c2f6955e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:56.574850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c80e4-b3ca-4c0d-bc07-09c2f6955e32 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.575677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c80e4-b3ca-4c0d-bc07-09c2f6955e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.575677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c80e4-b3ca-4c0d-bc07-09c2f6955e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.586403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c80e4-b3ca-4c0d-bc07-09c2f6955e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:56.611939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c80e4-b3ca-4c0d-bc07-09c2f6955e32 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:56.624471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1137/2268] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:56.707688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:56.827566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591e4dc-2410-44d3-9b82-b51d9dc5449a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:56.832099 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:56.833030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.833352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.833757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] PATH_INFO: `/v3/users/2956ee49c3354ad187a9f9bef7ceac66` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.834886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2956ee49c3354ad187a9f9bef7ceac66)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:56.861685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:56.914268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2956ee49c3354ad187a9f9bef7ceac66'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:56.922154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2956ee49c3354ad187a9f9bef7ceac66'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:56.930474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2956ee49c3354ad187a9f9bef7ceac66'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:56.932390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2956ee49c3354ad187a9f9bef7ceac66'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:56.932984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2956ee49c3354ad187a9f9bef7ceac66'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:56.951745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1132/2269] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:56 2022] DELETE /identity/v3/users/2956ee49c3354ad187a9f9bef7ceac66 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:56.956638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:56.957106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:56.957206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:56.979994 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:56.981163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:57.060067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1138/2270] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:57.070834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:57.072455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:57.141499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5926407-6a48-4e84-b203-8d877cd1bd70 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:57.145430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:57.146026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:57.146314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:57.146603 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:57.156772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:57.184751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:57.196554 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1133/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:57.493559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:57.503850 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c523-8c68-4fe4-99cb-60124a06b956 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:57.508276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:57.508999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:57.509286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:57.509536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:57.512215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:57.622691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:57.648638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:57.674583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1139/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:57.727049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:57.729010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:57.731646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:57.739569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:57.743299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667e466-3495-4822-bf34-c6cd4455b5fa service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:57.750534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:57.750680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09c524-d9ec-4326-afd1-07f304f6fd86 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:57.751465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:57.751920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:57.752207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] PATH_INFO: `/v3/projects/0b4af6ba490e474a950bbac98ab914e3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:57.753939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4af6ba490e474a950bbac98ab914e3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:57.754247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:57.754861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:57.755148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:57.755558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:57.757178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:57.770589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:57.779171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:57.796669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:57.807877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1140/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:51:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:51:57.832586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4af6ba490e474a950bbac98ab914e3', 'request_id': 'req-63add49f-327e-44c1-b8da-0157e2c27a29'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:57.838812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4af6ba490e474a950bbac98ab914e3', 'request_id': 'req-63add49f-327e-44c1-b8da-0157e2c27a29'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:57.847435 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4af6ba490e474a950bbac98ab914e3', 'request_id': 'req-63add49f-327e-44c1-b8da-0157e2c27a29'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:57.864910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] The token cache is being invalidate because project 0b4af6ba490e474a950bbac98ab914e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:57.865191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:57.865810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:57.867531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1134/2274] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:57 2022] DELETE /identity/v3/projects/0b4af6ba490e474a950bbac98ab914e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:57.871942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:57.882375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc0813-3342-44cb-ac77-a7a54320e888 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:57.948727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:57.949567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:57.949844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:57.950116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] PATH_INFO: `/v3/users/6ff98f28745d455b96ef7ede35795199` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:57.951248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff98f28745d455b96ef7ede35795199)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:57.977548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:58.032259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff98f28745d455b96ef7ede35795199'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.039684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff98f28745d455b96ef7ede35795199'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.040310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff98f28745d455b96ef7ede35795199'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.053335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff98f28745d455b96ef7ede35795199'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.061645 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-718feb09-5368-4870-baa3-82a81266f9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff98f28745d455b96ef7ede35795199'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.067802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1141/2275] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:51:57 2022] DELETE /identity/v3/users/6ff98f28745d455b96ef7ede35795199 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:58.501856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:58.503437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:58.516612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63add49f-327e-44c1-b8da-0157e2c27a29 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:58.589200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:58.590085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:58.590367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:58.590706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] PATH_INFO: `/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:58.591799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfa1b3d22804b92a55adf9d4bda635a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:58.617244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:58.672744 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfa1b3d22804b92a55adf9d4bda635a', 'request_id': 'req-1a77f953-075a-41e2-9a1a-eb2974c6be9a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.678362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfa1b3d22804b92a55adf9d4bda635a', 'request_id': 'req-1a77f953-075a-41e2-9a1a-eb2974c6be9a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.688795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfa1b3d22804b92a55adf9d4bda635a', 'request_id': 'req-1a77f953-075a-41e2-9a1a-eb2974c6be9a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.706083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] The token cache is being invalidate because project 3cfa1b3d22804b92a55adf9d4bda635a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:51:58.706367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.707354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-1a77f953-075a-41e2-9a1a-eb2974c6be9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:51:58.708536 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1135/2276] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:51:58 2022] DELETE /identity/v3/projects/3cfa1b3d22804b92a55adf9d4bda635a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:58.713788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:58.714115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:58.714812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:58.736997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:58.738256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:58.815306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1142/2277] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:58.823455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:58.824045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:58.824401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:58.857246 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:58.858679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:58.870121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1136/2278] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:58.871846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:58.881927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa5004-e642-4fda-8b3a-bbad3acb6a15 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:58.886821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:58.887469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:58.887836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:58.888161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:58.888925 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:51:58.889300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:58.914938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:58.929560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1143/2279] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:51:58.934134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:58.944955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a907f73-fe46-45af-9675-a658f41f6020 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:58.950849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:58.951454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:58.951998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:58.952495 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:58.953309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:58.980967 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.018761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1137/2280] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:58 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:59.023075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.036588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1c67-7e73-4c34-baee-759d03696ed2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.102993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.103802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.104121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.104396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.105080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.131001 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.152508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1144/2281] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:59 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:59.156643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.167723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1c53c-490d-422a-b6d8-4e601dbddec8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.172656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f7594-e491-452e-8f0b-9456261cf9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.173257 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7594-e491-452e-8f0b-9456261cf9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.173540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7594-e491-452e-8f0b-9456261cf9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.173819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f7594-e491-452e-8f0b-9456261cf9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.174521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f7594-e491-452e-8f0b-9456261cf9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.200517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f7594-e491-452e-8f0b-9456261cf9a5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.211220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1138/2282] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:59.215453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.225197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b15f-4139-4927-8c5a-706cc3e3859d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.229941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.230810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.231097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.231374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] PATH_INFO: `/v3/projects/0511e262164e421c87cc5826c1c5e6e0/users/506f6405938945b0a86fa8fc38184d18/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.252343 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0511e262164e421c87cc5826c1c5e6e0, user_id=506f6405938945b0a86fa8fc38184d18, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.278931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.294520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1145/2283] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:59 2022] PUT /identity/v3/projects/0511e262164e421c87cc5826c1c5e6e0/users/506f6405938945b0a86fa8fc38184d18/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:59.305576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.305876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.306165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.344400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] MFA Rules not processed for user `506f6405938945b0a86fa8fc38184d18`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:59.345621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:59.425353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1139/2284] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:59 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:59.430077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.501486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49597bba-f181-4748-bcb0-b67edc20a31e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.506109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.506737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.506997 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.507308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.507941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.534140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.565857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1146/2285] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:59 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:59.567117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.579185 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1ea0e-c07d-47ee-bfdb-2f2f3bcabea4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.652995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.653747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.654064 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.654347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.655038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.681192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.705520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1140/2286] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:51:59 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:51:59.709599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.720172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fece86-b4bd-4e91-a2dd-5066dd1c2899 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.725192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea38b14-e571-4766-8032-ea4cd709f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.725786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38b14-e571-4766-8032-ea4cd709f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.726073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38b14-e571-4766-8032-ea4cd709f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.726350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea38b14-e571-4766-8032-ea4cd709f2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.727081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38b14-e571-4766-8032-ea4cd709f2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.753056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea38b14-e571-4766-8032-ea4cd709f2b5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.764782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1147/2287] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:51:59.768985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:51:59.779703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a076e-c7ea-4a52-b908-5ba2ad7dfbea admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:51:59.784566 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:51:59.785501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.785853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.786223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] PATH_INFO: `/v3/projects/73ede5dc114c4b58956cc98dd16264af/users/89927c1e244e4839954a57bf3b93653e/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.806946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ede5dc114c4b58956cc98dd16264af, user_id=89927c1e244e4839954a57bf3b93653e, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:51:59.833600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:51:59.849960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1141/2288] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:51:59 2022] PUT /identity/v3/projects/73ede5dc114c4b58956cc98dd16264af/users/89927c1e244e4839954a57bf3b93653e/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:51:59.860310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:51:59.860854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:51:59.861241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:51:59.908413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] MFA Rules not processed for user `89927c1e244e4839954a57bf3b93653e`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:51:59.909596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:51:59.983030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1148/2289] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:51:59 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:51:59.987491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.072115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dcd5-46c4-4e61-aad6-645c1cc35b41 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.077521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.078136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.078425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.078738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.079538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.109423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.144883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.147076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1142/2290] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:51:59 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:00.155837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10808-53a8-4dc8-92da-8ff75f2521d0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.235036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.235755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.236818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.237205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.237957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.267488 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.294588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1149/2291] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:00 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:00.295885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.307023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d5b6-368d-4351-9fa3-ca919ec99d25 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.311671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.312424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.312718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.312996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.313696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.339280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.351070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1143/2292] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:52:00.355670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.365140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf968cc7-8027-4468-8c5c-057679af77bc admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.369290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.370119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.370403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.370726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] PATH_INFO: `/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f/users/4913dc47f0e245eabc1c8d9eef287617/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.395726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2122c5b77cf4478aaeb4063f55acdf3f, user_id=4913dc47f0e245eabc1c8d9eef287617, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.425781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.444129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1150/2293] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:00 2022] PUT /identity/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f/users/4913dc47f0e245eabc1c8d9eef287617/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:00.448639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.469709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f3059-894c-4599-b1e7-2638e68d1b0a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.553620 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.554250 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.554540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.554854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.555561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.583579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.595133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1144/2294] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:00.599012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.620951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b5644-ff1e-4129-bf1f-ad4060728494 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.626797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.628118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.628586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.628745 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] PATH_INFO: `/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f/users/4913dc47f0e245eabc1c8d9eef287617/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.630693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2122c5b77cf4478aaeb4063f55acdf3f, user_id=4913dc47f0e245eabc1c8d9eef287617, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.660524 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.672403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1151/2295] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:00 2022] PUT /identity/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f/users/4913dc47f0e245eabc1c8d9eef287617/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:00.676051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.686653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a0273-8aec-4670-96a5-16d148c2b09b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.766028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d331-4d97-48f5-8169-bb7d34f6ebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.766851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d331-4d97-48f5-8169-bb7d34f6ebd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.767314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d331-4d97-48f5-8169-bb7d34f6ebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.767692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d331-4d97-48f5-8169-bb7d34f6ebd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.769303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d331-4d97-48f5-8169-bb7d34f6ebd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.798256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1d331-4d97-48f5-8169-bb7d34f6ebd4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.810073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1145/2296] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:52:00.814612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:00.824569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e94b9-18d5-4977-b50a-7d451dcf671d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:00.830082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:00.830980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.831271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.831550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] PATH_INFO: `/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f/users/4913dc47f0e245eabc1c8d9eef287617/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.833324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2122c5b77cf4478aaeb4063f55acdf3f, user_id=4913dc47f0e245eabc1c8d9eef287617, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:00.860934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:00.888282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1152/2297] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:00 2022] PUT /identity/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f/users/4913dc47f0e245eabc1c8d9eef287617/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:00.898247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:00.898616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:00.908739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:00.957834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] MFA Rules not processed for user `4913dc47f0e245eabc1c8d9eef287617`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:00.959342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:01.044027 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1146/2298] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:00 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:01.055302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:01.057149 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:01.137331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a33bb-8a77-401a-a6ad-807c79a2939a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:01.140847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:01.141373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:01.141656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:01.141934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:01.151888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:01.179870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:01.203584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1153/2299] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:01 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:01.256606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:01.258137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:01.270646 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21e864-8b01-400d-94a8-6f01a0a0c2fb None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:01.273933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3516d7-3ddd-4c9b-a2dc-4307317be306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:01.274655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3516d7-3ddd-4c9b-a2dc-4307317be306 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:01.275016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3516d7-3ddd-4c9b-a2dc-4307317be306 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:01.275410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3516d7-3ddd-4c9b-a2dc-4307317be306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:01.349791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3516d7-3ddd-4c9b-a2dc-4307317be306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:01.380123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3516d7-3ddd-4c9b-a2dc-4307317be306 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:01.390588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1147/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:01 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:09.033146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:09.107371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cbb30-8314-4e16-ae1b-02921e5a2c7c service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:09.112371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:09.113200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:09.113637 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:09.114081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] PATH_INFO: `/v3/users/506f6405938945b0a86fa8fc38184d18` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:09.115334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506f6405938945b0a86fa8fc38184d18)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:09.143870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:09.215885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506f6405938945b0a86fa8fc38184d18'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.225623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506f6405938945b0a86fa8fc38184d18'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.226651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506f6405938945b0a86fa8fc38184d18'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.242944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506f6405938945b0a86fa8fc38184d18'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.253118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506f6405938945b0a86fa8fc38184d18'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.261344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1154/2301] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:09 2022] DELETE /identity/v3/users/506f6405938945b0a86fa8fc38184d18 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:09.265733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:09.266239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:09.266350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:09.289714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:09.291172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:09.364000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1148/2302] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:09.374214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:09.375782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:09.441949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af4376-1017-47ba-aa83-a2985c79ebf5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:09.445578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:09.446169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:09.446457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:09.446769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:09.456576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:09.481757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:09.491622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1155/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:09.853423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:09.859406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:09.876708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f165c5-cc94-4849-a39e-d0b3978de3a1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:09.881277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:09.882157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:09.882503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:09.882987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] PATH_INFO: `/v3/projects/0511e262164e421c87cc5826c1c5e6e0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:09.884141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0511e262164e421c87cc5826c1c5e6e0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:09.910405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:09.962838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0511e262164e421c87cc5826c1c5e6e0', 'request_id': 'req-928f4912-e61c-4b58-b750-44db61a97c4e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.967755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0511e262164e421c87cc5826c1c5e6e0', 'request_id': 'req-928f4912-e61c-4b58-b750-44db61a97c4e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.977525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0511e262164e421c87cc5826c1c5e6e0', 'request_id': 'req-928f4912-e61c-4b58-b750-44db61a97c4e'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.995515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] The token cache is being invalidate because project 0511e262164e421c87cc5826c1c5e6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:09.995809 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:09.996423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.000654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1149/2304] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:09 2022] DELETE /identity/v3/projects/0511e262164e421c87cc5826c1c5e6e0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:10.002018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:10.012105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e90284-8f0f-403e-a7b0-d8404a4027b9 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:10.077117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:10.078105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:10.078387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:10.078701 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] PATH_INFO: `/v3/users/89927c1e244e4839954a57bf3b93653e` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:10.079782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] RBAC: Authorizing `identity:delete_user(user_id=89927c1e244e4839954a57bf3b93653e)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:10.105707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:10.160027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89927c1e244e4839954a57bf3b93653e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.172002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89927c1e244e4839954a57bf3b93653e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.172785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89927c1e244e4839954a57bf3b93653e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.190372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89927c1e244e4839954a57bf3b93653e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.198292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89927c1e244e4839954a57bf3b93653e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.204895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1156/2305] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:10 2022] DELETE /identity/v3/users/89927c1e244e4839954a57bf3b93653e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:10.752345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:10.753868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:10.767021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f4912-e61c-4b58-b750-44db61a97c4e admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:10.836727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:10.837561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:10.837849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:10.838128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] PATH_INFO: `/v3/projects/73ede5dc114c4b58956cc98dd16264af` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:10.839432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ede5dc114c4b58956cc98dd16264af)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:10.864800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:10.920968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ede5dc114c4b58956cc98dd16264af', 'request_id': 'req-aba07375-0bd1-48a4-8126-029117c390b1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.926385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ede5dc114c4b58956cc98dd16264af', 'request_id': 'req-aba07375-0bd1-48a4-8126-029117c390b1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.934770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ede5dc114c4b58956cc98dd16264af', 'request_id': 'req-aba07375-0bd1-48a4-8126-029117c390b1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.950881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] The token cache is being invalidate because project 73ede5dc114c4b58956cc98dd16264af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:10.951161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.951764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:10.953202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1150/2306] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:10 2022] DELETE /identity/v3/projects/73ede5dc114c4b58956cc98dd16264af => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:10.957476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:10.958798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:10.971346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82eaa-18bb-4e29-b26a-6aa8b684567d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:11.044213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:11.045133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:11.045480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:11.045780 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] PATH_INFO: `/v3/users/4913dc47f0e245eabc1c8d9eef287617` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:11.047591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4913dc47f0e245eabc1c8d9eef287617)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:11.082168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:11.137418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4913dc47f0e245eabc1c8d9eef287617'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.146277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4913dc47f0e245eabc1c8d9eef287617'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.146940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4913dc47f0e245eabc1c8d9eef287617'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.162826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4913dc47f0e245eabc1c8d9eef287617'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.173444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-312a5597-55d4-47b3-9c26-2343c5fb3eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4913dc47f0e245eabc1c8d9eef287617'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.179874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1157/2307] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:10 2022] DELETE /identity/v3/users/4913dc47f0e245eabc1c8d9eef287617 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:11.541563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:11.543202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:11.565411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07375-0bd1-48a4-8126-029117c390b1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:11.658187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:11.659186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:11.659745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:11.660232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] PATH_INFO: `/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:11.661429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2122c5b77cf4478aaeb4063f55acdf3f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:11.689565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:11.752153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2122c5b77cf4478aaeb4063f55acdf3f', 'request_id': 'req-6ee37b1e-c327-4029-a135-5015fa72c40c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.759013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2122c5b77cf4478aaeb4063f55acdf3f', 'request_id': 'req-6ee37b1e-c327-4029-a135-5015fa72c40c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.767866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2122c5b77cf4478aaeb4063f55acdf3f', 'request_id': 'req-6ee37b1e-c327-4029-a135-5015fa72c40c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.785094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] The token cache is being invalidate because project 2122c5b77cf4478aaeb4063f55acdf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:11.785487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.786191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6ee37b1e-c327-4029-a135-5015fa72c40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:11.787977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1151/2308] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:11 2022] DELETE /identity/v3/projects/2122c5b77cf4478aaeb4063f55acdf3f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:11.793974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:11.794336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:11.794743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:11.818415 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:11.819338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:11.892825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1158/2309] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:11.902254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:11.902574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:11.902865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:11.925475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:11.926663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:11.934501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1152/2310] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:11.939285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:11.948861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ab5cc-8751-47e3-a6d7-5edb8e33afa3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:11.954145 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:11.954760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:11.955040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:11.955314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:11.956035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:52:11.956325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:11.981764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:11.995076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1159/2311] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:11.999586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:12.008618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b0792-6c0f-4f64-871e-a77cdd50b93d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:12.013917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:12.014504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:12.014827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:12.015105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:12.015741 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:12.041615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:12.071608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1153/2312] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:11 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:12.078336 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:12.091499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc837e99-4015-4b5f-9519-7ba36e382758 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:12.168042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:12.169175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:12.169422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:12.170008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:12.170974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:12.197059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:12.218270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1160/2313] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:12 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:12.222272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:12.232792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348938b-c278-4cd8-b714-4593fedfc4be admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:12.237244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd93fed-c77b-4512-b38b-219bbb65e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:12.237831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd93fed-c77b-4512-b38b-219bbb65e67a admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:12.238113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd93fed-c77b-4512-b38b-219bbb65e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:12.238389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd93fed-c77b-4512-b38b-219bbb65e67a admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:12.239113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd93fed-c77b-4512-b38b-219bbb65e67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:12.266157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd93fed-c77b-4512-b38b-219bbb65e67a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:12.277930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1154/2314] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:12.282252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:12.292350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f197b3-649d-47b8-a5c9-a032268a5540 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:12.296949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:12.297759 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:12.298039 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:12.298314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] PATH_INFO: `/v3/projects/34ece9a24046484ab2e695a4f1fa2fab/users/584922596ab94aa9baaf7b2aa3b15825/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:12.318393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ece9a24046484ab2e695a4f1fa2fab, user_id=584922596ab94aa9baaf7b2aa3b15825, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:12.344418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:12.360224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1161/2315] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:12 2022] PUT /identity/v3/projects/34ece9a24046484ab2e695a4f1fa2fab/users/584922596ab94aa9baaf7b2aa3b15825/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:12.371941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:12.372278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:12.372584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:12.411319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] MFA Rules not processed for user `584922596ab94aa9baaf7b2aa3b15825`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:12.412504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:12.486520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1155/2316] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:12.497084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:12.498954 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:12.564514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f3063-b105-46c2-b96f-8668a18ec4d7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:12.567916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:12.568492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:12.568798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:12.569079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:12.577753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:12.602854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:12.612403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1162/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:12.933324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:12.934778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:13.138682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb268920-a702-4773-a51a-e62afdfd4ff9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:13.145317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:13.146599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:13.148003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:13.148593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:13.158886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:13.180220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:13.219996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:13.233328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1156/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:21.528940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:21.530506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:21.614060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760f597-d3fc-44d0-8b19-c06160248be3 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:21.619639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:21.620249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:21.620525 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:21.620822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:21.621201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:21.622823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:21.630208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839333a-2701-4e5f-81bc-ce1570ae7fea service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:21.633995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:21.634765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:21.635093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:21.635375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:21.635557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:21.637052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:21.661184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:21.672088 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1163/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:21 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:21.708124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:21.733740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b2e2-75bc-408e-b81d-763924d56977 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:21.743204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1157/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:21 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:52:26.330093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:26.331849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:26.413922 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2910d-5b65-4f2e-b39b-6d548f947ffd service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:26.418757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:26.419599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:26.419895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:26.420167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] PATH_INFO: `/v3/users/e772e46b1dbd4e8ca1b6aad2f1ddda6d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:26.421348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e772e46b1dbd4e8ca1b6aad2f1ddda6d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:26.447491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:26.498475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e772e46b1dbd4e8ca1b6aad2f1ddda6d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:26.506204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e772e46b1dbd4e8ca1b6aad2f1ddda6d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:26.506818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e772e46b1dbd4e8ca1b6aad2f1ddda6d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:26.519106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e772e46b1dbd4e8ca1b6aad2f1ddda6d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:26.526574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e772e46b1dbd4e8ca1b6aad2f1ddda6d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:26.532297 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1164/2321] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:26 2022] DELETE /identity/v3/users/e772e46b1dbd4e8ca1b6aad2f1ddda6d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:26.536813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:26.537307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:26.537405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:26.561410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:26.562580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:26.633326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1158/2322] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:26.643981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:26.645487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:26.712460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f5945-fbbb-4e7d-ae5f-abd85390ae4c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:26.716885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:26.717455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:26.717736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:26.718010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:26.727837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:26.753730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:26.763462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1165/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:27.142399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:27.143890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:27.155665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87dae7-7bd3-4d46-969c-7c073272318c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:27.160757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:27.161713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:27.161991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:27.162268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] PATH_INFO: `/v3/projects/65a8a0b637b144eab7a9339a6fc16f95` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:27.163695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a8a0b637b144eab7a9339a6fc16f95)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:27.189935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:27.240739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a8a0b637b144eab7a9339a6fc16f95', 'request_id': 'req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.247985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a8a0b637b144eab7a9339a6fc16f95', 'request_id': 'req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.260644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a8a0b637b144eab7a9339a6fc16f95', 'request_id': 'req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.277932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] The token cache is being invalidate because project 65a8a0b637b144eab7a9339a6fc16f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:27.278199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.278908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.280383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1159/2324] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:27 2022] DELETE /identity/v3/projects/65a8a0b637b144eab7a9339a6fc16f95 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:27.284662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:27.295939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4ade0-14fe-4ccf-81a6-29af0c1be4e0 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:27.361769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:27.362595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:27.362871 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:27.363144 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] PATH_INFO: `/v3/users/88996c28838f4ef4ae9f50b81a40c9cc` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:27.364258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88996c28838f4ef4ae9f50b81a40c9cc)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:27.390598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:27.443318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88996c28838f4ef4ae9f50b81a40c9cc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.451817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88996c28838f4ef4ae9f50b81a40c9cc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.452387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88996c28838f4ef4ae9f50b81a40c9cc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.463959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88996c28838f4ef4ae9f50b81a40c9cc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.473813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-aa28127f-87c3-470d-b69a-6d38c8d921e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88996c28838f4ef4ae9f50b81a40c9cc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:27.480497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1166/2325] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:27 2022] DELETE /identity/v3/users/88996c28838f4ef4ae9f50b81a40c9cc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:27.847380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:27.848906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:27.861828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d93024-6625-4c09-bf4d-8871ce5a0fdc admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:27.925364 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:27.926164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:27.926451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:27.926760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] PATH_INFO: `/v3/projects/1a6c2d62f4574faab8ff53725b57a3de` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:27.927965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6c2d62f4574faab8ff53725b57a3de)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:27.953724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.004644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6c2d62f4574faab8ff53725b57a3de', 'request_id': 'req-d7669edc-836b-4de9-841e-16cedc4df068'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:28.009890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6c2d62f4574faab8ff53725b57a3de', 'request_id': 'req-d7669edc-836b-4de9-841e-16cedc4df068'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:28.018773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6c2d62f4574faab8ff53725b57a3de', 'request_id': 'req-d7669edc-836b-4de9-841e-16cedc4df068'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:28.035659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] The token cache is being invalidate because project 1a6c2d62f4574faab8ff53725b57a3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:28.035942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:28.036828 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d7669edc-836b-4de9-841e-16cedc4df068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:28.037958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1160/2326] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:27 2022] DELETE /identity/v3/projects/1a6c2d62f4574faab8ff53725b57a3de => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:28.043243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11251-a157-4550-939a-4565fc550f69 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.043547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11251-a157-4550-939a-4565fc550f69 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.043827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f11251-a157-4550-939a-4565fc550f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.067257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-40f11251-a157-4550-939a-4565fc550f69 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:28.068372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-40f11251-a157-4550-939a-4565fc550f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:28.134319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1167/2327] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:28.142973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.143359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.143814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.169856 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:28.171037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:28.179303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1161/2328] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:28.183732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11251-a157-4550-939a-4565fc550f69 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.193449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f11251-a157-4550-939a-4565fc550f69 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.198147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.198756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.199049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.199333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.201377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:52:28.201377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.225716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.239544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1168/2329] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:28.244957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.254131 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b50775-284e-4f9c-a991-2d1c2386dade None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.258816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.259704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.259964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.260245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.260896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.292643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.326969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1162/2330] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:28.331017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.340944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83ae6-b504-43d8-9059-9382708068de admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.405313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.405980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.406181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.406591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.407245 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.432905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.455394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1169/2331] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:28.459539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.469837 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b6777-7a45-426b-adfd-36ff2902a391 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.474379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ed30-8c50-4e4c-a485-87bafd8d78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.475013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ed30-8c50-4e4c-a485-87bafd8d78ef admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.475300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ed30-8c50-4e4c-a485-87bafd8d78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.475580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ed30-8c50-4e4c-a485-87bafd8d78ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.476319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ed30-8c50-4e4c-a485-87bafd8d78ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.502448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6ed30-8c50-4e4c-a485-87bafd8d78ef admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.513170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1163/2332] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:28.519373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.529408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17d0fd-8150-4645-b8c6-36fe90975114 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.535154 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.535970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.536254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.536534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] PATH_INFO: `/v3/projects/34865b5935744f3e8133e26c493db01b/users/7e1276c0ceeb45f2bc9181100879c20a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.557198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34865b5935744f3e8133e26c493db01b, user_id=7e1276c0ceeb45f2bc9181100879c20a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.583445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.598825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1170/2333] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:28 2022] PUT /identity/v3/projects/34865b5935744f3e8133e26c493db01b/users/7e1276c0ceeb45f2bc9181100879c20a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:28.609655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.609935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.610222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.648930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] MFA Rules not processed for user `7e1276c0ceeb45f2bc9181100879c20a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:28.650116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:28.727268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1164/2334] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:28.731832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.800822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d7874-82bd-416c-994c-fe80fed7543f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.805242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.805832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.806197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.806467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.807153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.833443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.861835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1171/2335] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:28.865977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:28.877047 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b17a4-9f25-46e2-b20e-2f0ee2b73fd6 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:28.940551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:28.941162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:28.941447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:28.941726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:28.942394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:28.968125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:28.989409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1165/2336] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:28 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:28.993870 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.003768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcaaa2d-f4b2-4551-9dfa-2126ab89b96c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.008205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.008820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.009121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.009482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.010182 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.035534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.046689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1172/2337] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:29.050774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.061319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace40245-7e13-4ecd-9f27-fe1e0765a284 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.066387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.067272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.067604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.067882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] PATH_INFO: `/v3/projects/e2f8b85165134f8ca74d349aa04afbc1/users/21859adc30b243cc85a338657a512f47/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.088847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f8b85165134f8ca74d349aa04afbc1, user_id=21859adc30b243cc85a338657a512f47, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.114716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.140049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1166/2338] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:29 2022] PUT /identity/v3/projects/e2f8b85165134f8ca74d349aa04afbc1/users/21859adc30b243cc85a338657a512f47/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:29.144085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.153773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecc1b8-fb9b-48b6-a374-6c1171616e2a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.220597 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.221266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.221558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.221841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.222538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.248553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.260031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1173/2339] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:29.265275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.282029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a241-acf6-4f3e-9c78-a39e4f4ad4b9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.290804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.291769 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.292057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.292339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] PATH_INFO: `/v3/projects/e2f8b85165134f8ca74d349aa04afbc1/users/21859adc30b243cc85a338657a512f47/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.294377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f8b85165134f8ca74d349aa04afbc1, user_id=21859adc30b243cc85a338657a512f47, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.320896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.337159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1167/2340] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:29 2022] PUT /identity/v3/projects/e2f8b85165134f8ca74d349aa04afbc1/users/21859adc30b243cc85a338657a512f47/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:29.342825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.360175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63af32-c674-4efa-8a0d-693bca308cc9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.432957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f2fb4-521a-4f23-b5f9-7d69e524001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.433667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2fb4-521a-4f23-b5f9-7d69e524001c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.433799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2fb4-521a-4f23-b5f9-7d69e524001c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.434087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f2fb4-521a-4f23-b5f9-7d69e524001c admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.435210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f2fb4-521a-4f23-b5f9-7d69e524001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.460306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f2fb4-521a-4f23-b5f9-7d69e524001c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.472309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1174/2341] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:29.478323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.488934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a483ec-07a3-47c2-bcb4-e86625df3de3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.496139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.497470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.497860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.498225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] PATH_INFO: `/v3/projects/e2f8b85165134f8ca74d349aa04afbc1/users/21859adc30b243cc85a338657a512f47/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.500729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f8b85165134f8ca74d349aa04afbc1, user_id=21859adc30b243cc85a338657a512f47, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.532498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.552063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1168/2342] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:29 2022] PUT /identity/v3/projects/e2f8b85165134f8ca74d349aa04afbc1/users/21859adc30b243cc85a338657a512f47/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:29.565065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.565366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.565641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.607285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] MFA Rules not processed for user `21859adc30b243cc85a338657a512f47`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:29.608450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:29.701483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1175/2343] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:29 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:29.714492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.716589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:29.802618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a1bc9-8cc1-49c6-a4f0-eadc1953b791 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:29.807662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:29.808512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:29.808796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:29.809077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:29.823126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:29.851660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:29.863134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1169/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:29 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:29.983723 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:29.985394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:29.997477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e6619-e0bf-43bd-898a-4a6a1e51d380 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:30.001223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2256b-20cd-4d8f-a43a-d426c0de3863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:30.002206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2256b-20cd-4d8f-a43a-d426c0de3863 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:30.002616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2256b-20cd-4d8f-a43a-d426c0de3863 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:30.003000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2256b-20cd-4d8f-a43a-d426c0de3863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:30.095457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2256b-20cd-4d8f-a43a-d426c0de3863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:30.121707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2256b-20cd-4d8f-a43a-d426c0de3863 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:30.131050 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1176/2345] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:29 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:32.108868 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:32.185956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fe329-5547-414c-9c5e-7ac04c0516ee service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:32.190346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:32.191141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:32.191429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:32.191708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] PATH_INFO: `/v3/users/7e1276c0ceeb45f2bc9181100879c20a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:32.192779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1276c0ceeb45f2bc9181100879c20a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:32.218346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:32.270614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1276c0ceeb45f2bc9181100879c20a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:32.279512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1276c0ceeb45f2bc9181100879c20a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:32.288826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1276c0ceeb45f2bc9181100879c20a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:32.289443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1276c0ceeb45f2bc9181100879c20a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:32.290021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1276c0ceeb45f2bc9181100879c20a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:32.307406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1170/2346] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:32 2022] DELETE /identity/v3/users/7e1276c0ceeb45f2bc9181100879c20a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:32.312473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582561a-31f9-4dfc-836c-42742d2b0594 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:32.313000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582561a-31f9-4dfc-836c-42742d2b0594 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:32.313110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582561a-31f9-4dfc-836c-42742d2b0594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:32.336160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-2582561a-31f9-4dfc-836c-42742d2b0594 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:32.337308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2582561a-31f9-4dfc-836c-42742d2b0594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:32.407434 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1177/2347] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:32.417844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:32.419569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:32.487453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82024-1833-4524-8116-cb38d4f8b2c5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:32.490797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:32.491382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:32.491668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:32.491916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:32.501776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:32.528101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:32.538261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1171/2348] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:32.689965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:32.690511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:32.690887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:32.774293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:32.775806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:32.862682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1178/2349] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:32.908668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:32.910122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:32.923415 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:32.924984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:32.943124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae50f5-4419-4f72-9798-6c28c7e94cca None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:32.947839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:32.948622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:32.948899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:32.949174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] PATH_INFO: `/v3/projects/34865b5935744f3e8133e26c493db01b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:32.950230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34865b5935744f3e8133e26c493db01b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:32.985732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:33.023870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527c32-b477-4028-9e30-6cba89f44892 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:33.028561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391dd9c-3982-428e-b939-fdb3f3b76ff0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:33.029147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391dd9c-3982-428e-b939-fdb3f3b76ff0 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.029464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391dd9c-3982-428e-b939-fdb3f3b76ff0 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.029739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391dd9c-3982-428e-b939-fdb3f3b76ff0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.037728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391dd9c-3982-428e-b939-fdb3f3b76ff0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:33.038816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34865b5935744f3e8133e26c493db01b', 'request_id': 'req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.043731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34865b5935744f3e8133e26c493db01b', 'request_id': 'req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.051669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34865b5935744f3e8133e26c493db01b', 'request_id': 'req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.065991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391dd9c-3982-428e-b939-fdb3f3b76ff0 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:33.067857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] The token cache is being invalidate because project 34865b5935744f3e8133e26c493db01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:33.068142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.068752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.070248 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1179/2350] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:32 2022] DELETE /identity/v3/projects/34865b5935744f3e8133e26c493db01b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:33.074747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:33.075969 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:33.078256 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1172/2351] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:52:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:52:33.147353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08e3e8-d527-4bbe-8d81-ef7ecb271f73 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:33.153027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:33.154082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.154401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.154851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] PATH_INFO: `/v3/users/21859adc30b243cc85a338657a512f47` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.155987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21859adc30b243cc85a338657a512f47)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:33.186143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:33.242785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21859adc30b243cc85a338657a512f47'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.251785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21859adc30b243cc85a338657a512f47'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.252408 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21859adc30b243cc85a338657a512f47'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.264674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21859adc30b243cc85a338657a512f47'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.272742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21859adc30b243cc85a338657a512f47'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.279517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1180/2352] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:33 2022] DELETE /identity/v3/users/21859adc30b243cc85a338657a512f47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:33.623676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.624130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.624233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.646721 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:33.647857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:33.665512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:33.667236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:33.710143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1173/2353] 10.222.0.18 () {58 vars in 967 bytes} [Mon Feb 28 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:33.722017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:33.723304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:33.738100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6662174-ae44-4946-a9c8-7569308a71e0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:33.742098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:33.742912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.743192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.743638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] PATH_INFO: `/v3/projects/e2f8b85165134f8ca74d349aa04afbc1` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.744763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f8b85165134f8ca74d349aa04afbc1)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:33.769899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:33.795706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637224bd-05f2-4ea2-808e-ce0757c2fa84 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:33.800581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee235409-b001-45a2-b524-0dcb14f7fe71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:33.801259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235409-b001-45a2-b524-0dcb14f7fe71 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.801562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235409-b001-45a2-b524-0dcb14f7fe71 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.801883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee235409-b001-45a2-b524-0dcb14f7fe71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.810461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee235409-b001-45a2-b524-0dcb14f7fe71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:33.820456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f8b85165134f8ca74d349aa04afbc1', 'request_id': 'req-e244e26b-c996-4884-a91d-36bc4e089106'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.825716 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f8b85165134f8ca74d349aa04afbc1', 'request_id': 'req-e244e26b-c996-4884-a91d-36bc4e089106'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.833731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f8b85165134f8ca74d349aa04afbc1', 'request_id': 'req-e244e26b-c996-4884-a91d-36bc4e089106'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.836129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee235409-b001-45a2-b524-0dcb14f7fe71 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:33.844466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1174/2354] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:52:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 18:52:33.851065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] The token cache is being invalidate because project e2f8b85165134f8ca74d349aa04afbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:33.851351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.851979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e244e26b-c996-4884-a91d-36bc4e089106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:33.853505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1181/2355] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:33 2022] DELETE /identity/v3/projects/e2f8b85165134f8ca74d349aa04afbc1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:33.858300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.858739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.859027 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.886869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:33.888204 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:33.960339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1175/2356] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:33.967830 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310987-811a-4dbf-bae3-070a35da0cb3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:33.968340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310987-811a-4dbf-bae3-070a35da0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:33.968827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310987-811a-4dbf-bae3-070a35da0cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:33.996138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f7310987-811a-4dbf-bae3-070a35da0cb3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:33.997634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f7310987-811a-4dbf-bae3-070a35da0cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:34.015419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1182/2357] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:34.019319 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.028515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832729-8318-4d1b-85da-8eee07180c7a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.032917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.033508 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.033795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.034063 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.034775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:52:34.035070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.061095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.078549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1176/2358] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:34.079205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.079475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.079596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.079787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.089608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed5749-283e-4827-a25f-703c991183bb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.094747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.095476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.095845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.096217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.096939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.108321 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:34.109896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:34.122873 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.152991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1177/2359] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:34.157264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.197385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1183/2360] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:34.210903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.213350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:34.231484 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffade93-ad6f-4445-b970-a3677e4e6b98 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.236382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.237190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.237552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.237902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.238640 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.266944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.295244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1178/2361] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:34.297831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.299109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a25052-0c5b-4aa2-b596-06a66c353b17 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.308313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e3541-99e1-43a4-b5d2-02afdf451b14 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.313622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.314220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.314784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.315076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.315790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.345804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.360089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1179/2362] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:52:34.361779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.374236 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b55b-1f43-4036-bffa-e518accf49d9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.375586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.376316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.376735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.377057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.379616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee5c41-5921-4844-ad9a-b33082dafb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.380515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee5c41-5921-4844-ad9a-b33082dafb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.381132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee5c41-5921-4844-ad9a-b33082dafb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.381711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee5c41-5921-4844-ad9a-b33082dafb0e admin admin] PATH_INFO: `/v3/projects/da490f77df6d4d57bc21b91762566eed/users/d1ff5e8a0f464b70b592cd06a0d0ff98/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.408897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee5c41-5921-4844-ad9a-b33082dafb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da490f77df6d4d57bc21b91762566eed, user_id=d1ff5e8a0f464b70b592cd06a0d0ff98, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.439479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee5c41-5921-4844-ad9a-b33082dafb0e admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.447222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.455357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1180/2363] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:34 2022] PUT /identity/v3/projects/da490f77df6d4d57bc21b91762566eed/users/d1ff5e8a0f464b70b592cd06a0d0ff98/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:34.467054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d616e-d884-4837-9753-32e9612fc934 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.467337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d616e-d884-4837-9753-32e9612fc934 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.467650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d616e-d884-4837-9753-32e9612fc934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.473070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.483532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1184/2364] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:52:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:52:34.506474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-423d616e-d884-4837-9753-32e9612fc934 None None] MFA Rules not processed for user `d1ff5e8a0f464b70b592cd06a0d0ff98`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:34.507653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-423d616e-d884-4837-9753-32e9612fc934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:34.588115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1181/2365] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:34.592773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.602895 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5620-0299-47ab-9829-bbce1574320a service swift] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.676696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598c566-e490-4562-a887-cb98c9112986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.677380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598c566-e490-4562-a887-cb98c9112986 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.677855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598c566-e490-4562-a887-cb98c9112986 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.677855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598c566-e490-4562-a887-cb98c9112986 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.678458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598c566-e490-4562-a887-cb98c9112986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.717882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598c566-e490-4562-a887-cb98c9112986 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.749614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1185/2366] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:34.751084 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d616e-d884-4837-9753-32e9612fc934 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.761543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d616e-d884-4837-9753-32e9612fc934 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.825035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.825807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.826039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.826385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.827091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.853415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.857829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.858130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.858414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.875398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1182/2367] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:34.879280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.885823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:34.887036 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:34.889023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5c099-c121-4557-9c07-b776a84fa13b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.893768 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.894393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.894722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.895007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.895718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:34.921420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:34.932049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1183/2368] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:52:34.936486 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.945363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fbe2-fa4f-4980-95f1-0182a2aa16ca admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:34.949736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1186/2369] 10.222.0.18 () {58 vars in 967 bytes} [Mon Feb 28 18:52:34 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:34.949884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba9851-3422-4e21-94c0-b8a58982f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:34.950675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba9851-3422-4e21-94c0-b8a58982f1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:34.950969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba9851-3422-4e21-94c0-b8a58982f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:34.951253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba9851-3422-4e21-94c0-b8a58982f1f6 admin admin] PATH_INFO: `/v3/projects/183a7fd2ead24ebf924d4139edca27da/users/18bfdc13e46f46b983ea3b20a2fdf56b/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:34.961574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:34.973546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba9851-3422-4e21-94c0-b8a58982f1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183a7fd2ead24ebf924d4139edca27da, user_id=18bfdc13e46f46b983ea3b20a2fdf56b, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.003176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba9851-3422-4e21-94c0-b8a58982f1f6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.024655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1184/2370] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:34 2022] PUT /identity/v3/projects/183a7fd2ead24ebf924d4139edca27da/users/18bfdc13e46f46b983ea3b20a2fdf56b/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:35.026133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.026429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.026737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.034208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7543b-562d-499b-89af-09cbcfe3f726 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.063784 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] MFA Rules not processed for user `18bfdc13e46f46b983ea3b20a2fdf56b`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:35.064957 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:35.101583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.102177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.102468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.102949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.135325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1185/2371] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:35 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:35.139730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.166808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.195760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.206009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1187/2372] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:52:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:52:35.221323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03a67-301b-4a03-b909-5e6d574a3e1e None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.225774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.226651 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.227024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.227434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.228141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.254845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.283224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1186/2373] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:35 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:35.287166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.297397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c39eb7-1a47-4201-b1ba-4dd6f1387ca0 service swift] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.369697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.370313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.370628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.370912 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.371572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.397796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.422052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1188/2374] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:35 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:35.424109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.434490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96530b6-a945-4835-a409-5a3795f1b2e4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.439438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.440465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.440723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.441092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.441960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.477338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.489933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1187/2375] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:52:35.490715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.508073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05a47a-8810-4fa9-9972-a38dbbb39635 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.508073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.508073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.508073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.508378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] PATH_INFO: `/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef/users/d6c83fb134114748ac45803ac0af80d0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.527143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86920b0a36c41c9bf1dda8aef27d4ef, user_id=d6c83fb134114748ac45803ac0af80d0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.554600 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.570620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1189/2376] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:35 2022] PUT /identity/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef/users/d6c83fb134114748ac45803ac0af80d0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:35.574521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.584754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4901-8ec2-4012-906f-325bf19398b7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.661547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.662510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.662964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.663443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.664337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.691604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.701643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1188/2377] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:35.705905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.716784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cdd73-7d30-4dda-bc13-07c6f05889b7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.727965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.729571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.729864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.730372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] PATH_INFO: `/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef/users/d6c83fb134114748ac45803ac0af80d0/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.732718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86920b0a36c41c9bf1dda8aef27d4ef, user_id=d6c83fb134114748ac45803ac0af80d0, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.767204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.779385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1190/2378] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:35 2022] PUT /identity/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef/users/d6c83fb134114748ac45803ac0af80d0/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:35.784327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.796546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e350b-7929-42ff-ae3a-2bda285112ef admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.870668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64005c-35e6-4915-ada5-530a12d50093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.871274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64005c-35e6-4915-ada5-530a12d50093 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.871559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64005c-35e6-4915-ada5-530a12d50093 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.871833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64005c-35e6-4915-ada5-530a12d50093 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.872527 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64005c-35e6-4915-ada5-530a12d50093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.897938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64005c-35e6-4915-ada5-530a12d50093 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.908482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1189/2379] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:35.912654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:35.922943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105603ba-13cf-494f-b5aa-a1a7301f4191 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:35.927398 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:35.928218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.928502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.928781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] PATH_INFO: `/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef/users/d6c83fb134114748ac45803ac0af80d0/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:35.930541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86920b0a36c41c9bf1dda8aef27d4ef, user_id=d6c83fb134114748ac45803ac0af80d0, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:35.958178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:35.975053 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1191/2380] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:35 2022] PUT /identity/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef/users/d6c83fb134114748ac45803ac0af80d0/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:35.986774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:35.987212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:35.987675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:36.027922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] MFA Rules not processed for user `d6c83fb134114748ac45803ac0af80d0`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:36.029090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:36.107038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1190/2381] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:35 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:36.116385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:36.118353 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:36.190199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00812b-8e1c-442e-90a3-5445fd95e905 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:36.194738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:36.195317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:36.195603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:36.195880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:36.205803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:36.230743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:36.243534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1192/2382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:36 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:36.787058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:36.797043 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28383961-bd9c-4ec4-98d1-7fb02f8659db None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:36.800331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c6060-440b-4e8b-bee1-0a0155feb8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:36.800903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6060-440b-4e8b-bee1-0a0155feb8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:36.801188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6060-440b-4e8b-bee1-0a0155feb8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:36.801459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c6060-440b-4e8b-bee1-0a0155feb8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:36.866668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c6060-440b-4e8b-bee1-0a0155feb8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:36.891979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c6060-440b-4e8b-bee1-0a0155feb8e4 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:36.901269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1191/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:36 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:41.182444 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:41.184855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:41.291593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466ea6-a493-4c5e-85fc-6075b68d6a5d service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:41.296265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:41.297160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:41.297510 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:41.297987 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] PATH_INFO: `/v3/users/879264cb35e9400f9c2378698ffd533f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:41.299163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879264cb35e9400f9c2378698ffd533f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:41.325804 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:41.381699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879264cb35e9400f9c2378698ffd533f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:41.390732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879264cb35e9400f9c2378698ffd533f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:41.391565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879264cb35e9400f9c2378698ffd533f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:41.404718 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879264cb35e9400f9c2378698ffd533f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:41.412340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879264cb35e9400f9c2378698ffd533f'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:41.421934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1193/2384] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:41 2022] DELETE /identity/v3/users/879264cb35e9400f9c2378698ffd533f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:41.426673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:41.427194 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:41.427295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:41.449372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:41.450902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:41.526543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1192/2385] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:41.536581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:41.537951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:41.645021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c3a82-dc24-47cc-a469-b354a5ff50c3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:41.648644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27e825-a1e4-4f54-b6ae-6a64b384bf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:41.649225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e825-a1e4-4f54-b6ae-6a64b384bf57 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:41.649514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e825-a1e4-4f54-b6ae-6a64b384bf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:41.649795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e825-a1e4-4f54-b6ae-6a64b384bf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:41.659978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e825-a1e4-4f54-b6ae-6a64b384bf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:41.686684 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e825-a1e4-4f54-b6ae-6a64b384bf57 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:41.698108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1194/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:41.976686 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:41.978370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.000130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e471556-f6fd-4735-83b7-cdc9bd543ecf None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.004778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.005581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.005871 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.006154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] PATH_INFO: `/v3/projects/3e4d231c0cb9427ea1db5986f6af3929` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.007265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4d231c0cb9427ea1db5986f6af3929)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.032842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.086522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4d231c0cb9427ea1db5986f6af3929', 'request_id': 'req-f17eb591-8f33-4086-8271-aad332d05636'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:42.091336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4d231c0cb9427ea1db5986f6af3929', 'request_id': 'req-f17eb591-8f33-4086-8271-aad332d05636'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:42.099763 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4d231c0cb9427ea1db5986f6af3929', 'request_id': 'req-f17eb591-8f33-4086-8271-aad332d05636'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:42.115454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] The token cache is being invalidate because project 3e4d231c0cb9427ea1db5986f6af3929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:42.115738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:42.116466 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f17eb591-8f33-4086-8271-aad332d05636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:42.117930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1193/2387] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:41 2022] DELETE /identity/v3/projects/3e4d231c0cb9427ea1db5986f6af3929 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:42.123061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.123414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.123699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.147089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:42.148239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.214373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1195/2388] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:42.222211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a642778-2949-43de-8640-9331f356ea52 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.222538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a642778-2949-43de-8640-9331f356ea52 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.222876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a642778-2949-43de-8640-9331f356ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.246425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9a642778-2949-43de-8640-9331f356ea52 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:42.247779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9a642778-2949-43de-8640-9331f356ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.256765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1194/2389] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:42.261284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.270832 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8661502-e408-4104-8d7d-c204bddf006a None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.275640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.276232 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.276522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.276805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.277502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:52:42.277800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.303352 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.318170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1196/2390] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:42.323142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a642778-2949-43de-8640-9331f356ea52 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.332706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a642778-2949-43de-8640-9331f356ea52 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.337129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.337713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.338009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.338284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.339017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.367680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.403630 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1195/2391] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:42 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:42.404893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.414857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50988a80-1827-4ebf-b8e9-61c5f18fa0e9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.568110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.568709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.569025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.569302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.569936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.595449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.619778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1197/2392] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:42 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:42.624870 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.640927 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a6564-6353-43d7-b6d9-992a5269c13c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.647879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bc27-4636-4762-8f49-8102bef84ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.648642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bc27-4636-4762-8f49-8102bef84ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.649011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bc27-4636-4762-8f49-8102bef84ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.649439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bc27-4636-4762-8f49-8102bef84ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.650572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9bc27-4636-4762-8f49-8102bef84ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.676456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9bc27-4636-4762-8f49-8102bef84ab3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.688215 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1196/2393] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:42.693401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.705056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd66b60-c504-4498-b31e-33dcf23eb5dd admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.710648 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.711464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.711753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.712023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] PATH_INFO: `/v3/projects/16e7d713da4349b3977dab0041ed0bee/users/549b7a82cab9488a815c3e68a95b10db/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.732653 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e7d713da4349b3977dab0041ed0bee, user_id=549b7a82cab9488a815c3e68a95b10db, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.758332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.773004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1198/2394] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:42 2022] PUT /identity/v3/projects/16e7d713da4349b3977dab0041ed0bee/users/549b7a82cab9488a815c3e68a95b10db/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:42.778145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.778439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.778764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.800955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:42.802097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.869579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1197/2395] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:42.879670 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:42.881501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:42.945671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5c7b-7f30-4e33-bc5c-a250733e244b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:42.949142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:42.949724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:42.950010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:42.950287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:42.959270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:42.986760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:42.997963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1199/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:44.863851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:44.869851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:44.960911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13867aa-59b7-4f55-902c-dc3fa208b741 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:44.965452 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:44.966128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:44.966666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:44.967762 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:44.969684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:45.079459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:45.112457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae29be-8404-49c8-ad0a-055f286f73d1 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:45.122602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1198/2397] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:44 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:47.178522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:47.180836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:47.199640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cea168-362c-4db9-b16e-57451bcb6b9e service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:47.205586 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:47.207283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:47.207846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:47.208176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] PATH_INFO: `/v3/users/584922596ab94aa9baaf7b2aa3b15825` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:47.209570 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=584922596ab94aa9baaf7b2aa3b15825)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:47.239565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:47.301544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584922596ab94aa9baaf7b2aa3b15825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:47.313693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584922596ab94aa9baaf7b2aa3b15825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:47.314988 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584922596ab94aa9baaf7b2aa3b15825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:47.334238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584922596ab94aa9baaf7b2aa3b15825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:47.343378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584922596ab94aa9baaf7b2aa3b15825'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:47.350605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1200/2398] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:47 2022] DELETE /identity/v3/users/584922596ab94aa9baaf7b2aa3b15825 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:47.354509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:47.355459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:47.355936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:47.383858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:47.385510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:47.461638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1199/2399] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:47.483128 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:47.485079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:47.556762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4c7d1-e866-4a31-b8d5-d9a02a343a05 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:47.561540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb3e5d-51fa-4f1e-a002-30bc3b4f0355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:47.562243 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb3e5d-51fa-4f1e-a002-30bc3b4f0355 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:47.563573 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb3e5d-51fa-4f1e-a002-30bc3b4f0355 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:47.563990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb3e5d-51fa-4f1e-a002-30bc3b4f0355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:47.575125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb3e5d-51fa-4f1e-a002-30bc3b4f0355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:47.603419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb3e5d-51fa-4f1e-a002-30bc3b4f0355 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:47.615634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1201/2400] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:48.041038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:48.042892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.054793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece0353-5298-4856-a11d-a51bc675f9a3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:48.060581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:48.061892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.062414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.062923 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] PATH_INFO: `/v3/users/d1ff5e8a0f464b70b592cd06a0d0ff98` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.064506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ff5e8a0f464b70b592cd06a0d0ff98)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:48.092331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:48.176371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ff5e8a0f464b70b592cd06a0d0ff98'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.186643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ff5e8a0f464b70b592cd06a0d0ff98'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.201040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ff5e8a0f464b70b592cd06a0d0ff98'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.202632 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ff5e8a0f464b70b592cd06a0d0ff98'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.205261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ff5e8a0f464b70b592cd06a0d0ff98'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.239183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1200/2401] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:48 2022] DELETE /identity/v3/users/d1ff5e8a0f464b70b592cd06a0d0ff98 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:48.244468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.245554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.245989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.270963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:48.273947 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.360211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1202/2402] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:48.441093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:48.443302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.542575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742f7a-34ac-4369-96cd-f610979a4ba0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:48.547184 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a839488-84c5-441f-90ee-86df7c9bb7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:48.547990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a839488-84c5-441f-90ee-86df7c9bb7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.548775 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a839488-84c5-441f-90ee-86df7c9bb7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.549325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a839488-84c5-441f-90ee-86df7c9bb7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.551689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:48.553059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.566541 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c777218-c5d4-4c33-a384-1f196e670106 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:48.566796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a839488-84c5-441f-90ee-86df7c9bb7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:48.571849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:48.573085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.573584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.574069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] PATH_INFO: `/v3/projects/34ece9a24046484ab2e695a4f1fa2fab` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.575528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ece9a24046484ab2e695a4f1fa2fab)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:48.600012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a839488-84c5-441f-90ee-86df7c9bb7b6 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:48.606184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:48.614123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1201/2403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:48.676132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ece9a24046484ab2e695a4f1fa2fab', 'request_id': 'req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.683663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ece9a24046484ab2e695a4f1fa2fab', 'request_id': 'req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.696138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ece9a24046484ab2e695a4f1fa2fab', 'request_id': 'req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.718588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] The token cache is being invalidate because project 34ece9a24046484ab2e695a4f1fa2fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:48.718957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.719614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ca0cc5d3-28c5-44ef-9f4c-5fc46a5a9316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:48.721676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1203/2404] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:48 2022] DELETE /identity/v3/projects/34ece9a24046484ab2e695a4f1fa2fab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:48.726959 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.727332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.727687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.753604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:48.754930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.870361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1202/2405] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:48.878917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf2ff-9a68-43b7-9ffe-ea03d679f077 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.879278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf2ff-9a68-43b7-9ffe-ea03d679f077 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.880233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bf2ff-9a68-43b7-9ffe-ea03d679f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.905705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ee6bf2ff-9a68-43b7-9ffe-ea03d679f077 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:48.907153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ee6bf2ff-9a68-43b7-9ffe-ea03d679f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:48.915825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1204/2406] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:48.920247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:48.931451 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0e145-4fd2-4b7d-98c7-94aef8ee46f6 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:48.936921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:48.938014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.938423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.938834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.939677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:52:48.940079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:48.980585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:48.989027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:48.989319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:48.989598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:48.998607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1203/2407] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:49.003609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.014455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ab658-6ee3-432c-b5a0-afacfb60df62 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.020062 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.020660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.020953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.021234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.021874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.038140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] MFA Rules not processed for user `549b7a82cab9488a815c3e68a95b10db`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:49.039425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.048332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.086271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1204/2408] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:49 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:49.093095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.158089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1205/2409] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:49.159807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.161389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.176089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c7bc-080d-4349-b4c2-cc10739b2bf0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.176472 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd06f4a-7e9c-46f0-a5be-74577d174b12 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.183199 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.183500 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.184637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.184920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.185198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.185854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.190392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.190692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.190976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.191657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.215702 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.223924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.248335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1205/2410] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:49 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:49.248335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.250315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.264751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1206/2411] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:49 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:49.266138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.266312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e821-1f47-4df0-83fe-4ccdf6c3b41f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.372584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.373389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.373675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.373918 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824265a-36a7-4553-b234-0d71239f06b8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.374040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] PATH_INFO: `/v3/projects/da490f77df6d4d57bc21b91762566eed` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.375077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=da490f77df6d4d57bc21b91762566eed)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.380948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.381461 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.381998 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.382325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.383204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.406173 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.411543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.424022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1207/2412] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:49.424991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.436547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c2aa0-f70b-4c09-8aff-71e9f61385fa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.441861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.442501 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.443004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.443482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.444212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.467567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da490f77df6d4d57bc21b91762566eed', 'request_id': 'req-de943c0c-6e65-4b34-b312-6568eaabf1ac'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.471229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.473534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da490f77df6d4d57bc21b91762566eed', 'request_id': 'req-de943c0c-6e65-4b34-b312-6568eaabf1ac'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.483807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da490f77df6d4d57bc21b91762566eed', 'request_id': 'req-de943c0c-6e65-4b34-b312-6568eaabf1ac'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.493704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1208/2413] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:49 2022] POST /identity/v3/users => generated 296 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:49.495012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.506640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42b080-4497-4f35-8a43-3666f05ce689 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.506884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] The token cache is being invalidate because project da490f77df6d4d57bc21b91762566eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:49.507119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.507830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.509382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1206/2414] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:49 2022] DELETE /identity/v3/projects/da490f77df6d4d57bc21b91762566eed => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:49.510596 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.513350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.582816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.583587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.583877 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.584160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] PATH_INFO: `/v3/projects/cbf2b9318fb845dab79d447739877511/users/4d92486e607a4eb2adb9d21d740fbbc2/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.605849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf2b9318fb845dab79d447739877511, user_id=4d92486e607a4eb2adb9d21d740fbbc2, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.632848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.655972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1209/2415] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:49 2022] PUT /identity/v3/projects/cbf2b9318fb845dab79d447739877511/users/4d92486e607a4eb2adb9d21d740fbbc2/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:49.657301 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.660610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.677824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de943c0c-6e65-4b34-b312-6568eaabf1ac admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.751204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e076e-4ecc-4beb-ba1c-a0f71779c7fa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.757733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.758569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.758866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.759143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] PATH_INFO: `/v3/users/18bfdc13e46f46b983ea3b20a2fdf56b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.761702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18bfdc13e46f46b983ea3b20a2fdf56b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.769562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da62658-f209-4797-9042-b80b7b782d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.770387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da62658-f209-4797-9042-b80b7b782d09 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.770777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da62658-f209-4797-9042-b80b7b782d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.771127 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da62658-f209-4797-9042-b80b7b782d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.771895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da62658-f209-4797-9042-b80b7b782d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.787787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.801001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da62658-f209-4797-9042-b80b7b782d09 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.813876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1207/2416] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:49.815322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.815676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.816017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.849334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18bfdc13e46f46b983ea3b20a2fdf56b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.850198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:49.852017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.861333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18bfdc13e46f46b983ea3b20a2fdf56b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.862038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18bfdc13e46f46b983ea3b20a2fdf56b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.862939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1208/2417] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:49.868088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.878292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18bfdc13e46f46b983ea3b20a2fdf56b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.889634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c158a-4669-4b51-b87d-bf2754a6e986 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:49.894728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:49.895463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18bfdc13e46f46b983ea3b20a2fdf56b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:49.896374 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:49.896814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:49.897285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] PATH_INFO: `/v3/projects/bfc39115fa0644a5a324aa4890e86bfc/users/878dcd37521b40a39f68c714576de60d/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:49.904072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1210/2418] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:49 2022] DELETE /identity/v3/users/18bfdc13e46f46b983ea3b20a2fdf56b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:49.907276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.907276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:49.942399 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc39115fa0644a5a324aa4890e86bfc, user_id=878dcd37521b40a39f68c714576de60d, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:49.971920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:49.994543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1209/2419] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:49 2022] PUT /identity/v3/projects/bfc39115fa0644a5a324aa4890e86bfc/users/878dcd37521b40a39f68c714576de60d/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:49.996465 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:49.998479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:50.007065 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a700-ff5a-4353-b43e-fc58f7b71a30 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.093656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.094350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.094528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.094835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.096777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:50.125350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff443-fce6-4f52-b9e7-0956f2238dfe admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.130921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.131526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.131813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.132270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.132974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.159096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.173305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1210/2420] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:50.177647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:50.187899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d34b6-eed8-449e-990f-50ba3bb36c76 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.188720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.192153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.192974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.193264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.193549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] PATH_INFO: `/v3/projects/bfc39115fa0644a5a324aa4890e86bfc/users/878dcd37521b40a39f68c714576de60d/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.195419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc39115fa0644a5a324aa4890e86bfc, user_id=878dcd37521b40a39f68c714576de60d, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.214332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.225084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1211/2421] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:50.226841 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.241528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1211/2422] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:50 2022] PUT /identity/v3/projects/bfc39115fa0644a5a324aa4890e86bfc/users/878dcd37521b40a39f68c714576de60d/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:50.242707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:50.252369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbb0d7-bbee-429b-9a38-7c7f87c50a54 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.319208 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.319892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.320085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.320360 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.321049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.347963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.359127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1212/2423] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:50.363479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:50.376328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b3cd7-0f24-4422-bb32-c7ee4da1b789 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.382842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.383753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.384715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.384715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] PATH_INFO: `/v3/projects/bfc39115fa0644a5a324aa4890e86bfc/users/878dcd37521b40a39f68c714576de60d/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.388363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc39115fa0644a5a324aa4890e86bfc, user_id=878dcd37521b40a39f68c714576de60d, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.416344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.432493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1212/2424] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:50 2022] PUT /identity/v3/projects/bfc39115fa0644a5a324aa4890e86bfc/users/878dcd37521b40a39f68c714576de60d/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:50.471522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:50.473100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:50.487204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a98f6-facf-4ea8-b6ac-2bf6ce7335e6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.567549 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.568595 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.569486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.569916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] PATH_INFO: `/v3/projects/183a7fd2ead24ebf924d4139edca27da` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.571317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183a7fd2ead24ebf924d4139edca27da)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.598082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.655317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183a7fd2ead24ebf924d4139edca27da', 'request_id': 'req-676bf460-b410-4cd8-ad4f-b138b6967525'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.661866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183a7fd2ead24ebf924d4139edca27da', 'request_id': 'req-676bf460-b410-4cd8-ad4f-b138b6967525'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.671339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183a7fd2ead24ebf924d4139edca27da', 'request_id': 'req-676bf460-b410-4cd8-ad4f-b138b6967525'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.689898 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] The token cache is being invalidate because project 183a7fd2ead24ebf924d4139edca27da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:50.690526 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.691227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-676bf460-b410-4cd8-ad4f-b138b6967525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.696400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1213/2425] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:50 2022] DELETE /identity/v3/projects/183a7fd2ead24ebf924d4139edca27da => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:50.697909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:50.700776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:50.720921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70bd73-9891-4b87-9869-69f820e8cd38 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:50.801463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:50.802746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:50.803106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:50.803463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] PATH_INFO: `/v3/users/d6c83fb134114748ac45803ac0af80d0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:50.806081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c83fb134114748ac45803ac0af80d0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:50.837587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:50.909795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c83fb134114748ac45803ac0af80d0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.920802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c83fb134114748ac45803ac0af80d0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.932573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c83fb134114748ac45803ac0af80d0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.933244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c83fb134114748ac45803ac0af80d0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.933875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c83fb134114748ac45803ac0af80d0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:50.970932 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1213/2426] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:50 2022] DELETE /identity/v3/users/d6c83fb134114748ac45803ac0af80d0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:51.291270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:51.291566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:51.291849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:51.345893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] MFA Rules not processed for user `4d92486e607a4eb2adb9d21d740fbbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:51.347913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:51.461560 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1214/2427] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:51.470899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:51.472403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:51.575060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:51.576813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:51.591222 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca170f29-48b2-476c-874e-a3d57f173581 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:51.595059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cab20-65a2-40f5-a04c-7b9a484dd320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:51.595658 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cab20-65a2-40f5-a04c-7b9a484dd320 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:51.595958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cab20-65a2-40f5-a04c-7b9a484dd320 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:51.596227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cab20-65a2-40f5-a04c-7b9a484dd320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:51.607078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cab20-65a2-40f5-a04c-7b9a484dd320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:51.632669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cab20-65a2-40f5-a04c-7b9a484dd320 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:51.646021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1214/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:51 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:51.691748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063e87c-397e-4d4d-826a-8508f60f8081 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:51.702016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:51.703802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:51.704474 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:51.704965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] PATH_INFO: `/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:51.706827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86920b0a36c41c9bf1dda8aef27d4ef)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:51.740237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:51.805937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86920b0a36c41c9bf1dda8aef27d4ef', 'request_id': 'req-0ea50145-4bca-4f44-9f9e-563d4e74c96b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:51.812516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86920b0a36c41c9bf1dda8aef27d4ef', 'request_id': 'req-0ea50145-4bca-4f44-9f9e-563d4e74c96b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:51.821956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86920b0a36c41c9bf1dda8aef27d4ef', 'request_id': 'req-0ea50145-4bca-4f44-9f9e-563d4e74c96b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:51.846923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] The token cache is being invalidate because project d86920b0a36c41c9bf1dda8aef27d4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:51.847855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:51.849605 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-0ea50145-4bca-4f44-9f9e-563d4e74c96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:51.852953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1215/2429] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:51 2022] DELETE /identity/v3/projects/d86920b0a36c41c9bf1dda8aef27d4ef => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:52:51.858214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:51.858791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:51.858791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:51.903665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:51.904851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:52.014325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1215/2430] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:52.023393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.023960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.024379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.058965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:52.060943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:52.074061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1216/2431] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:52.075416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.089924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa269d-075b-4de2-8b89-bffb92ec66f9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.112065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.115657 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.119846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.120456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.122482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:52:52.123531 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:52.181013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:52.210788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1216/2432] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:52:52.215344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.225481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b6d5f-1e79-4a1c-b29d-6742fcffe91c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.249500 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.250117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.250399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.250707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.251379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:52.320085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:52.381742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1217/2433] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:52.388269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.409021 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b62a7-3b10-4af8-92c5-ffdb15cc592b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.501120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.501737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.502019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.502307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.503226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:52.533195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:52.555641 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1217/2434] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:52.560630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.571307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55480a-54be-48f3-ad38-9e3bcbd83564 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.575654 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91124df-20d0-479d-8ab1-925b38cc0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.576286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91124df-20d0-479d-8ab1-925b38cc0087 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.576569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91124df-20d0-479d-8ab1-925b38cc0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.577015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91124df-20d0-479d-8ab1-925b38cc0087 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.577709 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91124df-20d0-479d-8ab1-925b38cc0087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:52.604855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91124df-20d0-479d-8ab1-925b38cc0087 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:52.616866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1218/2435] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:52:52.621226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.634956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707520ad-2d15-442a-87c9-d7f9bf6f2df0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.641338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.643098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.643578 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.644045 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] PATH_INFO: `/v3/projects/40b67ed76fa04977b2927d29c843cca5/users/be087237d3ec43b8b38e58a561667dad/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.670415 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b67ed76fa04977b2927d29c843cca5, user_id=be087237d3ec43b8b38e58a561667dad, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:52.701327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:52.726673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1218/2436] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:52 2022] PUT /identity/v3/projects/40b67ed76fa04977b2927d29c843cca5/users/be087237d3ec43b8b38e58a561667dad/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:52.733733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.734049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.734337 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.773747 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] MFA Rules not processed for user `be087237d3ec43b8b38e58a561667dad`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:52.774428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:52.875543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1219/2437] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:52.880638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:52.962963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76404e-49ad-462c-aa3a-cd31d166bef1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:52.967948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:52.968559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:52.968848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:52.969132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:52.969776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:52.996055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.026549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1219/2438] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:52:52 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:52:53.030484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.041185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74451ea1-2172-41c5-94b3-89016b119aae None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.112872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.113569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.113924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.114320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.116169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.142396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.167676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1220/2439] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:52:53 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:52:53.172313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.183382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9089-b196-4a0b-8e18-d6d24f4f67ff admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.188456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dce09-c80a-4d5f-8231-9a3ea976cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.189392 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dce09-c80a-4d5f-8231-9a3ea976cc88 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.189684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dce09-c80a-4d5f-8231-9a3ea976cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.190263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dce09-c80a-4d5f-8231-9a3ea976cc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.191068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dce09-c80a-4d5f-8231-9a3ea976cc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.225434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dce09-c80a-4d5f-8231-9a3ea976cc88 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.241844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1220/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:53.245968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.258048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b787cc-8b62-4a21-af92-c34aaa312b1c admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.266545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.267932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.272084 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.274277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] PATH_INFO: `/v3/projects/8732aec45e614315a3a1f7a3974500cd/users/6dcd9d83ddcd4317a297d7218b9085a8/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.310608 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8732aec45e614315a3a1f7a3974500cd, user_id=6dcd9d83ddcd4317a297d7218b9085a8, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.314733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.315036 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.315343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.336111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.340638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] MFA Rules not processed for user `4d92486e607a4eb2adb9d21d740fbbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:53.341961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:53.354695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1221/2441] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:53 2022] PUT /identity/v3/projects/8732aec45e614315a3a1f7a3974500cd/users/6dcd9d83ddcd4317a297d7218b9085a8/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:53.358824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.469711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1221/2442] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:52:53.486687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795bb41-7c38-49bd-824f-2e331914b58a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.498538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.499192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.499660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.500100 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.500957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.539197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.556020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1222/2443] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:53.562237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.576264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e11ce-00ca-4947-8fbb-ef5b84d6d420 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.581074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.581989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.582342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.584223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] PATH_INFO: `/v3/projects/8732aec45e614315a3a1f7a3974500cd/users/6dcd9d83ddcd4317a297d7218b9085a8/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.586247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8732aec45e614315a3a1f7a3974500cd, user_id=6dcd9d83ddcd4317a297d7218b9085a8, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.643996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.671532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1222/2444] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:53 2022] PUT /identity/v3/projects/8732aec45e614315a3a1f7a3974500cd/users/6dcd9d83ddcd4317a297d7218b9085a8/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:53.672833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.684505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd66cd-e2d3-4cbe-a299-fc8404d61091 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.788239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec5d98-a471-4a04-8546-7709f1e89d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.789041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec5d98-a471-4a04-8546-7709f1e89d21 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.789417 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec5d98-a471-4a04-8546-7709f1e89d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.791609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec5d98-a471-4a04-8546-7709f1e89d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.792451 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec5d98-a471-4a04-8546-7709f1e89d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.827078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec5d98-a471-4a04-8546-7709f1e89d21 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.849244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1223/2445] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:52:53.853446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:53.869407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a68bd-cd3d-4534-8ad4-17f413fa289c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:53.879289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:53.880406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.880844 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.882503 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] PATH_INFO: `/v3/projects/8732aec45e614315a3a1f7a3974500cd/users/6dcd9d83ddcd4317a297d7218b9085a8/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:53.884778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8732aec45e614315a3a1f7a3974500cd, user_id=6dcd9d83ddcd4317a297d7218b9085a8, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:53.919628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:53.952446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1223/2446] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:52:53 2022] PUT /identity/v3/projects/8732aec45e614315a3a1f7a3974500cd/users/6dcd9d83ddcd4317a297d7218b9085a8/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:53.955959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:53.956335 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:53.956696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:54.008418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] MFA Rules not processed for user `6dcd9d83ddcd4317a297d7218b9085a8`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:54.009855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:54.129682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1224/2447] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3765 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:54.141507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:54.143201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:54.262638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:54.264210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:54.271517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b2cd-317e-4ee0-8e53-4fd391895845 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:54.285233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:54.285854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:54.286147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:54.286436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:54.302846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:54.352652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe1e3a-026d-4671-9b00-513913998852 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:54.354271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:54.356617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:54.357214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:54.357534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:54.357769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:54.362632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:54.365130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1224/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3765 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:54.376529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:54.410715 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:54.426891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:54.427116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1225/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:54.428771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:54.442933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017b8d5-971d-4fa4-bf33-20649842a0a3 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:54.447070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:54.448005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:54.448515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:54.448885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:54.535042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:54.565347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:54.585220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1225/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:55.082885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:55.084928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:55.217849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ee4c-b159-4185-af45-bbe55f35c556 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:55.224834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:55.225824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:55.226338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:55.226819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:55.229847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:55.247644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:55.301086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb24e9-2918-4891-b44f-0155b63ccc16 service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:55.329375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1226/2451] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:55 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:55.487887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:55.489879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:55.506459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50fbaa-720f-4d6a-8868-0dd6d3fa4d4f service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:55.513679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:55.514537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:55.515969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:55.516428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:55.518381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:55.533267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:55.567865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:55.581217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1226/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:55 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:57.544459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:57.545045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:57.545152 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:57.581823 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] MFA Rules not processed for user `878dcd37521b40a39f68c714576de60d`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:57.582990 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:57.682213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1227/2453] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:57.694776 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:57.696376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:57.779182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7253a-39ce-4469-b9c1-eca1975340ca service placement] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:57.784280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:57.784897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:57.785198 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:57.785474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:57.787112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:57.854217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:57.879563 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59344f-f28d-438e-aeb2-b26a56f4880b service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:57.890419 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1227/2454] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:57 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:52:58.736677 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:58.848958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4dbb-c736-4489-b97f-b6e50f813184 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:58.853494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:58.854432 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:58.854883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:58.855253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] PATH_INFO: `/v3/users/be087237d3ec43b8b38e58a561667dad` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:58.856528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be087237d3ec43b8b38e58a561667dad)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:58.890222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:58.942060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be087237d3ec43b8b38e58a561667dad'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:58.950311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be087237d3ec43b8b38e58a561667dad'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:58.951013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be087237d3ec43b8b38e58a561667dad'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:58.962930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be087237d3ec43b8b38e58a561667dad'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:58.970592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be087237d3ec43b8b38e58a561667dad'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:58.976404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1228/2455] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:58 2022] DELETE /identity/v3/users/be087237d3ec43b8b38e58a561667dad => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:58.981780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:58.982322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:58.982443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:59.007315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:52:59.008494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:59.080464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1228/2456] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:52:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:52:59.092009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:59.094009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:59.164657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da83bc-bf86-4246-8c5d-9b1ab9a48654 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:59.184087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:59.185025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:59.185316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:59.185593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:59.205765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:59.256662 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:59.267604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1229/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:52:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:52:59.805879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:59.807583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:52:59.818650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8fd48-7f90-49d1-a07d-04d75e5c1b22 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:52:59.825283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:52:59.826210 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:52:59.826543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:52:59.827026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] PATH_INFO: `/v3/projects/40b67ed76fa04977b2927d29c843cca5` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:52:59.828327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b67ed76fa04977b2927d29c843cca5)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:52:59.855813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:52:59.920773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b67ed76fa04977b2927d29c843cca5', 'request_id': 'req-7358d8c3-32a2-4f46-8254-a51dd919cbd6'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:59.926434 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b67ed76fa04977b2927d29c843cca5', 'request_id': 'req-7358d8c3-32a2-4f46-8254-a51dd919cbd6'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:59.936656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b67ed76fa04977b2927d29c843cca5', 'request_id': 'req-7358d8c3-32a2-4f46-8254-a51dd919cbd6'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:59.956393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] The token cache is being invalidate because project 40b67ed76fa04977b2927d29c843cca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:52:59.957077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:59.958653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:52:59.960540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1229/2458] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:52:59 2022] DELETE /identity/v3/projects/40b67ed76fa04977b2927d29c843cca5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:52:59.964482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:52:59.974229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00717c46-e08f-4de7-97a2-524853646cd2 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:00.041081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:00.041900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.042193 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.042469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] PATH_INFO: `/v3/users/6dcd9d83ddcd4317a297d7218b9085a8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.045130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcd9d83ddcd4317a297d7218b9085a8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:00.078624 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:00.134265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcd9d83ddcd4317a297d7218b9085a8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.142803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcd9d83ddcd4317a297d7218b9085a8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.143392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcd9d83ddcd4317a297d7218b9085a8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.155615 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcd9d83ddcd4317a297d7218b9085a8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.163425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-c836e82e-7a05-45a2-b7e1-21e15fb4ee18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcd9d83ddcd4317a297d7218b9085a8'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.171362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1230/2459] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:52:59 2022] DELETE /identity/v3/users/6dcd9d83ddcd4317a297d7218b9085a8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:53:00.582663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:00.585125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:00.599714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358d8c3-32a2-4f46-8254-a51dd919cbd6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:00.673845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:00.674986 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.675379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.675642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] PATH_INFO: `/v3/projects/8732aec45e614315a3a1f7a3974500cd` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.677187 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8732aec45e614315a3a1f7a3974500cd)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:00.709625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:00.765682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8732aec45e614315a3a1f7a3974500cd', 'request_id': 'req-18842498-8ebf-431c-943a-5ea117c56361'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.771306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8732aec45e614315a3a1f7a3974500cd', 'request_id': 'req-18842498-8ebf-431c-943a-5ea117c56361'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.779458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8732aec45e614315a3a1f7a3974500cd', 'request_id': 'req-18842498-8ebf-431c-943a-5ea117c56361'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.799648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] The token cache is being invalidate because project 8732aec45e614315a3a1f7a3974500cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:53:00.799970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.800579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-18842498-8ebf-431c-943a-5ea117c56361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:00.802328 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1230/2460] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:53:00 2022] DELETE /identity/v3/projects/8732aec45e614315a3a1f7a3974500cd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:00.807927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.808247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.808555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.834395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:00.835601 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:00.904033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1231/2461] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:00.915629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.916037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.916326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.940853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:00.942042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:00.951548 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1231/2462] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:00.955377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:00.965273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531192f1-54dc-490e-af89-38e7848cdcaf None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:00.970503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:00.971130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:00.971419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:00.971699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:00.972393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:53:00.972700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:00.997984 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.012661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1232/2463] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:53:01.017305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.027357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1039a-495e-4a08-95b5-068af48c45c3 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.033931 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.034584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.034869 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.035268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.035906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:01.064124 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.095678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1232/2464] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:53:01 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:01.100114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.112911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e97478-12a6-4345-8eb0-32786681daa1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.185974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.186594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.186881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.187186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.187811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:01.217799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.240887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1233/2465] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:53:01 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:01.247156 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.261590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0141b-97f0-47c8-852f-a16db54dbfe6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.269635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c2ffc-875f-416d-a4ad-8f62410ff42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.270408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c2ffc-875f-416d-a4ad-8f62410ff42b admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.270840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c2ffc-875f-416d-a4ad-8f62410ff42b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.271094 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c2ffc-875f-416d-a4ad-8f62410ff42b admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.272077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c2ffc-875f-416d-a4ad-8f62410ff42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:01.299739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c2ffc-875f-416d-a4ad-8f62410ff42b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.311772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1233/2466] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:53:01.316298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.327064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba06b1-5864-4d3b-bdd0-d8ffaaa43b61 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.332803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.333639 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.333924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.334203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] PATH_INFO: `/v3/projects/924b7ff83194467588aa8bcbb8d29ab1/users/3d78e3318cc8441ba25656320a3959fd/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.358048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924b7ff83194467588aa8bcbb8d29ab1, user_id=3d78e3318cc8441ba25656320a3959fd, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:01.384770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.402118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1234/2467] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:01 2022] PUT /identity/v3/projects/924b7ff83194467588aa8bcbb8d29ab1/users/3d78e3318cc8441ba25656320a3959fd/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:53:01.414140 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.414605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.414698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.461418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] MFA Rules not processed for user `3d78e3318cc8441ba25656320a3959fd`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:01.462609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:01.582902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1234/2468] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:01 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:01.587910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.675332 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449127-2603-427a-b4e9-e8b5816bba46 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.680122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.680748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.681045 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.681327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.682022 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:01.712179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.750480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1235/2469] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:53:01 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:53:01.754576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.767066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfe9fe-174d-48a4-a453-f603b6ad5bb1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.876181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.876817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.877111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.877398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.878044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:01.919498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:01.950241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1235/2470] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:53:01 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:01.955101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:01.965974 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b47c1-567a-4e4e-9a84-fe9dac08d2af admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:01.975256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:01.975930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:01.976224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:01.976503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:01.977214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.026750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.062809 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1236/2471] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:53:02.063804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:02.075303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99564a-8656-4536-86d8-22f1747c43ec admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:02.080984 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:02.082019 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.082542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.082928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] PATH_INFO: `/v3/projects/4d09a8d2daee45cba73d33bc859d0151/users/99137e47b43f45208cb73bd8f8fc7602/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.114460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d09a8d2daee45cba73d33bc859d0151, user_id=99137e47b43f45208cb73bd8f8fc7602, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.148370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.187522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1236/2472] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:02 2022] PUT /identity/v3/projects/4d09a8d2daee45cba73d33bc859d0151/users/99137e47b43f45208cb73bd8f8fc7602/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:02.191367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:02.204419 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c08d8e-9db9-468d-a4e8-304f572645c1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:02.271008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:02.272027 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.272516 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.272876 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.273757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.300209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.314629 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1237/2473] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:53:02.317181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:02.330207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b9cc3-b396-4c08-bd93-69b9e511a720 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:02.334857 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:02.335664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.335941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.336225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] PATH_INFO: `/v3/projects/4d09a8d2daee45cba73d33bc859d0151/users/99137e47b43f45208cb73bd8f8fc7602/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.337985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d09a8d2daee45cba73d33bc859d0151, user_id=99137e47b43f45208cb73bd8f8fc7602, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.365083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.376284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1237/2474] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:02 2022] PUT /identity/v3/projects/4d09a8d2daee45cba73d33bc859d0151/users/99137e47b43f45208cb73bd8f8fc7602/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:02.380392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:02.390220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e08f8-6b29-4780-bfcc-b00512bdba40 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:02.456098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98ad03-7c16-4bef-9a82-b81058233ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:02.456710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ad03-7c16-4bef-9a82-b81058233ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.456999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ad03-7c16-4bef-9a82-b81058233ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.457282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ad03-7c16-4bef-9a82-b81058233ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.457983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98ad03-7c16-4bef-9a82-b81058233ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.484086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98ad03-7c16-4bef-9a82-b81058233ab6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.495377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1238/2475] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:53:02.499455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:02.510645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5efeff-6678-4475-8c5e-24320fc62cb3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:02.515902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:02.516730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.517010 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.517286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] PATH_INFO: `/v3/projects/4d09a8d2daee45cba73d33bc859d0151/users/99137e47b43f45208cb73bd8f8fc7602/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.519385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d09a8d2daee45cba73d33bc859d0151, user_id=99137e47b43f45208cb73bd8f8fc7602, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.551693 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.573901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1238/2476] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:02 2022] PUT /identity/v3/projects/4d09a8d2daee45cba73d33bc859d0151/users/99137e47b43f45208cb73bd8f8fc7602/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:02.585547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.585846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.586151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.630691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] MFA Rules not processed for user `99137e47b43f45208cb73bd8f8fc7602`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:02.641118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:02.749340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1239/2477] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:02 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:02.762626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:02.764800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:02.844781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affa12a-d580-4dfe-ab20-1db490417f38 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:02.849565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:02.850216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:02.850594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:02.851322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:02.863558 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:02.891591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:02.902461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1239/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:02 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:03.001202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:03.011547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9b786-668b-4431-9e1f-057df0985d41 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:03.015124 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c8c1-3201-4138-86c7-864f0a768ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:03.015695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c8c1-3201-4138-86c7-864f0a768ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:03.015980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c8c1-3201-4138-86c7-864f0a768ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:03.016257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c8c1-3201-4138-86c7-864f0a768ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:03.084907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16c8c1-3201-4138-86c7-864f0a768ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:03.111380 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16c8c1-3201-4138-86c7-864f0a768ac3 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:03.121079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1240/2479] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:03 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:06.123946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:06.204490 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46785c0d-d8ec-4bca-bf5a-c78bacc0c66d service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:06.208971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:06.209787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:06.210076 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:06.210359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] PATH_INFO: `/v3/users/3d78e3318cc8441ba25656320a3959fd` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:06.211529 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d78e3318cc8441ba25656320a3959fd)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:06.238167 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:06.290377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d78e3318cc8441ba25656320a3959fd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:06.298182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d78e3318cc8441ba25656320a3959fd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:06.307666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d78e3318cc8441ba25656320a3959fd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:06.308278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d78e3318cc8441ba25656320a3959fd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:06.308882 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d78e3318cc8441ba25656320a3959fd'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:06.328498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1240/2480] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:53:06 2022] DELETE /identity/v3/users/3d78e3318cc8441ba25656320a3959fd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:06.333265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:06.333750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:06.333956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:06.359966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:06.361327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:06.432798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1241/2481] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:06.443570 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:06.445128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:06.521964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9221129-7e3a-4c9b-ac21-b34f4dd38ec3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:06.525643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:06.528470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:06.528470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:06.529636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:06.540874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:06.574130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:06.585011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1241/2482] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:53:07.000140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:07.002511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:07.021310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:07.022575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:07.036960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c7e3f-c84b-45bf-b5a3-1cbca07a353f service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:07.044565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:07.045377 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:07.045668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:07.045949 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] PATH_INFO: `/v3/projects/924b7ff83194467588aa8bcbb8d29ab1` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:07.047102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924b7ff83194467588aa8bcbb8d29ab1)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:07.085067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:07.154450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce96f-6338-43f9-afa4-3aaadc6e94b7 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:07.157910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924b7ff83194467588aa8bcbb8d29ab1', 'request_id': 'req-8098509c-ecaa-445e-baab-89f9d40fdba9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.163519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924b7ff83194467588aa8bcbb8d29ab1', 'request_id': 'req-8098509c-ecaa-445e-baab-89f9d40fdba9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.198335 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924b7ff83194467588aa8bcbb8d29ab1', 'request_id': 'req-8098509c-ecaa-445e-baab-89f9d40fdba9'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.227981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] The token cache is being invalidate because project 924b7ff83194467588aa8bcbb8d29ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:53:07.228265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.229623 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.236455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1242/2483] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:53:07 2022] DELETE /identity/v3/projects/924b7ff83194467588aa8bcbb8d29ab1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:07.240403 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:07.241197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:07.242038 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:07.242196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:07.242386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:07.242892 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:07.245097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:07.273118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:07.321638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:07.333091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1242/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:06 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:07.360802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098509c-ecaa-445e-baab-89f9d40fdba9 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:07.365835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:07.366697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:07.366988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:07.367269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] PATH_INFO: `/v3/users/99137e47b43f45208cb73bd8f8fc7602` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:07.368443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99137e47b43f45208cb73bd8f8fc7602)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:07.397183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:07.467627 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99137e47b43f45208cb73bd8f8fc7602'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.476481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99137e47b43f45208cb73bd8f8fc7602'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.486781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99137e47b43f45208cb73bd8f8fc7602'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.487696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99137e47b43f45208cb73bd8f8fc7602'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.488483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5a54b26e-574a-4d8b-b510-d55226c9de21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99137e47b43f45208cb73bd8f8fc7602'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:07.514609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1243/2485] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:53:07 2022] DELETE /identity/v3/users/99137e47b43f45208cb73bd8f8fc7602 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:53:07.989507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.001013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4217-3c81-4d59-a655-459ab3ba1876 service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:08.082319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:08.083233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.083588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.083941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] PATH_INFO: `/v3/projects/4d09a8d2daee45cba73d33bc859d0151` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.085121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d09a8d2daee45cba73d33bc859d0151)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:08.122373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:08.199905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d09a8d2daee45cba73d33bc859d0151', 'request_id': 'req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:08.205246 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d09a8d2daee45cba73d33bc859d0151', 'request_id': 'req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:08.220440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d09a8d2daee45cba73d33bc859d0151', 'request_id': 'req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:08.239350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] The token cache is being invalidate because project 4d09a8d2daee45cba73d33bc859d0151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:53:08.239646 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:08.240735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fbb671f0-f50b-4195-a6ed-a10f0c4c148e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:53:08.247101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1243/2486] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:53:07 2022] DELETE /identity/v3/projects/4d09a8d2daee45cba73d33bc859d0151 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:08.248888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.249360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.249444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.277348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:08.278926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:08.356847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1244/2487] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:08.365048 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.365690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.366156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.401040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:08.402274 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:08.410064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1244/2488] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:53:08.414468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.424341 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d70f-42f8-48c4-b402-e489ad7ee332 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:08.428736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:08.429331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.429616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.429897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.430617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:53:08.430930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:08.457201 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:08.471408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1245/2489] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:53:08.475577 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.484594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d99360-20f4-4c8b-aa37-3e036f19fb99 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:08.489223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:08.490000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.490349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.490687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.491382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:08.517354 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:08.555151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1245/2490] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:53:08 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:08.556300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.568271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58860609-0cb6-4f0b-9b90-2f9bb5f59c99 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:08.637777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:08.638383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.638734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.638971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.639682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:08.666022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:08.694613 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1246/2491] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:53:08 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:08.696470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.706184 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4145e-06c0-42b0-98b7-295f64dea111 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:08.710980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb1a61-a3b2-43de-9310-4ea84083eb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:08.711522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb1a61-a3b2-43de-9310-4ea84083eb58 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.711821 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb1a61-a3b2-43de-9310-4ea84083eb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.712080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb1a61-a3b2-43de-9310-4ea84083eb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.712775 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb1a61-a3b2-43de-9310-4ea84083eb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:08.746071 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb1a61-a3b2-43de-9310-4ea84083eb58 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:08.756636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1246/2492] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:53:08.760902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.770980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838610a6-ca4a-46e2-bb00-e8498a6e9f5c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:08.778594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:08.780202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.780540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.780838 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] PATH_INFO: `/v3/projects/9b10fda6245e4b409fad0032864b3671/users/2bb5beab7e474ae998979d4d815c7acc/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.800853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b10fda6245e4b409fad0032864b3671, user_id=2bb5beab7e474ae998979d4d815c7acc, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:08.827378 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:08.843226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1247/2493] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:08 2022] PUT /identity/v3/projects/9b10fda6245e4b409fad0032864b3671/users/2bb5beab7e474ae998979d4d815c7acc/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:53:08.849328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484ea14-58af-46a3-a963-b19a0a18310b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:08.849700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484ea14-58af-46a3-a963-b19a0a18310b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:08.850082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484ea14-58af-46a3-a963-b19a0a18310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:08.879993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e484ea14-58af-46a3-a963-b19a0a18310b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:08.881160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e484ea14-58af-46a3-a963-b19a0a18310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:08.950205 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1247/2494] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:08.961675 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:08.964197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:09.032874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde654-ae6a-4c8e-90dd-0eaecb221655 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:09.036718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2392eba-247b-4669-97e3-47f342a397eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:09.037351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392eba-247b-4669-97e3-47f342a397eb service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:09.037629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392eba-247b-4669-97e3-47f342a397eb service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:09.037900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392eba-247b-4669-97e3-47f342a397eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:09.047300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2392eba-247b-4669-97e3-47f342a397eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:09.072616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2392eba-247b-4669-97e3-47f342a397eb service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:09.082588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1248/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:53:15.114891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.115467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.115467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.139126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] MFA Rules not processed for user `4d92486e607a4eb2adb9d21d740fbbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:15.140322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:15.210016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.210569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.210695 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1248/2496] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:15 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:15.210802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.251381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] MFA Rules not processed for user `2bb5beab7e474ae998979d4d815c7acc`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:15.252539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:15.331979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1249/2497] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:15 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:53:15.336492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.346902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534cc65-3e93-4b1a-9556-b848357663e4 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.352012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.352538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.352820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.353096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.353872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:15.379614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:15.423527 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1249/2498] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:15.425188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.436572 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3e85d-f6a6-4d32-8384-84f7f3d02435 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.500815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.501547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.501824 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.502097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.502761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:15.529544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:15.554631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1250/2499] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:53:15 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:53:15.555902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.566619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966c4d-5794-4f5e-ab5e-9acf39ea5b41 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.571087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.571686 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.572215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.572557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.573260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:15.598407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:15.613518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1250/2500] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:53:15.614433 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.624656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f581b-81e5-473c-9c58-c1a3d8df5b58 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.628978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.629800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.630098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.630368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] PATH_INFO: `/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b/users/dcf23bdaa96941e3b554d8dd458911c1/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.653680 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c70f9c043f14f20b46b2bb5fdeb259b, user_id=dcf23bdaa96941e3b554d8dd458911c1, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:15.680066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:15.695271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1251/2501] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:15 2022] PUT /identity/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b/users/dcf23bdaa96941e3b554d8dd458911c1/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:15.699489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.709538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe62fe4-cbb3-46db-aed4-0dd18981c53d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.784591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.785299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.785653 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.786004 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.787012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:15.814441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:15.825749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1251/2502] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:53:15.829089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.839504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c6a5b-52b2-460b-9d00-3ee83f4e50a4 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.843961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.844827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.845119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.845395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] PATH_INFO: `/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b/users/dcf23bdaa96941e3b554d8dd458911c1/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.847237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c70f9c043f14f20b46b2bb5fdeb259b, user_id=dcf23bdaa96941e3b554d8dd458911c1, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:15.875200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:15.890362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1252/2503] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:15 2022] PUT /identity/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b/users/dcf23bdaa96941e3b554d8dd458911c1/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:53:15.890467 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:15.899388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761f1e-3a37-41c3-a09a-1da698f5bf81 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:15.973037 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ceeda-de04-41d5-8d8c-23bec210ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:15.973655 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ceeda-de04-41d5-8d8c-23bec210ae21 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:15.973942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ceeda-de04-41d5-8d8c-23bec210ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:15.974224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ceeda-de04-41d5-8d8c-23bec210ae21 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:15.978888 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ceeda-de04-41d5-8d8c-23bec210ae21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:16.009165 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ceeda-de04-41d5-8d8c-23bec210ae21 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:16.020854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1252/2504] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:53:16.024885 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:16.038098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b7013-a6c5-4c61-9783-380752f52257 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:16.043428 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee631c-abb8-4dde-9139-5f2123c9b467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:16.044411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee631c-abb8-4dde-9139-5f2123c9b467 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:16.044699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee631c-abb8-4dde-9139-5f2123c9b467 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:16.044982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee631c-abb8-4dde-9139-5f2123c9b467 admin admin] PATH_INFO: `/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b/users/dcf23bdaa96941e3b554d8dd458911c1/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:16.046760 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee631c-abb8-4dde-9139-5f2123c9b467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c70f9c043f14f20b46b2bb5fdeb259b, user_id=dcf23bdaa96941e3b554d8dd458911c1, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:16.074911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee631c-abb8-4dde-9139-5f2123c9b467 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:16.089163 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1253/2505] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:53:16 2022] PUT /identity/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b/users/dcf23bdaa96941e3b554d8dd458911c1/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:53:22.884181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:22.884784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:22.884784 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:22.909949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] MFA Rules not processed for user `549b7a82cab9488a815c3e68a95b10db`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:22.911159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:22.978603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1253/2506] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:24.470900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945aaa8-8939-402d-b022-31bf1a934a68 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:24.471564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945aaa8-8939-402d-b022-31bf1a934a68 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:24.471564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945aaa8-8939-402d-b022-31bf1a934a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:24.514539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b945aaa8-8939-402d-b022-31bf1a934a68 None None] MFA Rules not processed for user `dcf23bdaa96941e3b554d8dd458911c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:24.516148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b945aaa8-8939-402d-b022-31bf1a934a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:24.606720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1254/2507] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:24 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:24.621658 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:24.623081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:24.690627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e480f1-1712-4291-89b2-79be546aef77 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:24.694126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3caf8a53d924849b5cb756249a1a96f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:24.694748 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:24.695035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:24.695314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:24.761642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:24.787117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:24.796910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1254/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:24 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:53:24.903988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ce015-d8e3-4cb3-8103-93aecc33f8b1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:24.904423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ce015-d8e3-4cb3-8103-93aecc33f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:24.904743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ce015-d8e3-4cb3-8103-93aecc33f8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:24.928339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-880ce015-d8e3-4cb3-8103-93aecc33f8b1 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:24.929517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-880ce015-d8e3-4cb3-8103-93aecc33f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:24.994549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1255/2509] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:53:24 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:25.009451 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:25.011224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:25.089361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cb960-5588-4090-a213-61a0b0813ff8 service glance] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:25.095099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b31181-463b-4cea-9da5-2acedcb9c84f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:25.095717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b31181-463b-4cea-9da5-2acedcb9c84f service swift] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:25.095996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b31181-463b-4cea-9da5-2acedcb9c84f service swift] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:25.096279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b31181-463b-4cea-9da5-2acedcb9c84f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:25.105602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b31181-463b-4cea-9da5-2acedcb9c84f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:25.131554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b31181-463b-4cea-9da5-2acedcb9c84f service swift] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:25.140133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1255/2510] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:53:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:53:37.271202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:37.271800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:37.271800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:37.298628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] MFA Rules not processed for user `2bb5beab7e474ae998979d4d815c7acc`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:37.299789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:37.306576 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1256/2511] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:53:37 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:43.608934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781237b-c724-4573-a2fb-2f0432c22c40 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:43.609517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781237b-c724-4573-a2fb-2f0432c22c40 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:43.609517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781237b-c724-4573-a2fb-2f0432c22c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:43.634734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-0781237b-c724-4573-a2fb-2f0432c22c40 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:43.636085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0781237b-c724-4573-a2fb-2f0432c22c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:43.642574 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1256/2512] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:53:43.656307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:43.668436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda270b5-2640-4aa4-85f3-e0c68c8bfc1d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:43.673285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:43.674002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:43.674386 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:43.674797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:43.683396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:43.709022 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:43.717504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1257/2513] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 18:53:43.903160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:43.903826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:43.904329 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:43.938822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:53:43.940676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:43.952137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1257/2514] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:53:43.984087 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:44.000523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e0fac-786d-4d68-b52b-da63f4028236 service swift] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:44.014208 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:44.016561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:44.017104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:44.019739 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:44.035095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:44.070806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:44.081004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1258/2515] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:53:50.043530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:53:50.045700 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:50.200228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76db4e-e11d-4533-9aed-c56b20411bf6 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:53:50.218309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:53:50.218955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:53:50.219247 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:53:50.219540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:53:50.225538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:53:50.377213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:53:50.409267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5fbf8-bfc8-4dad-bedf-5b1a8cd9a94b service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:53:50.424122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1258/2516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:53:50 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:02.551410 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:02.643759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e8fd-6f5e-472d-aa8f-68984f220c65 service swift] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:02.647660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:02.648326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:02.648703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:02.649049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:02.650855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:02.752345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:02.780206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:02.791059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1259/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:02 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:04.165666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:04.166211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:04.166364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:04.194627 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:04.196142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:04.203318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1259/2518] 10.222.0.18 () {58 vars in 967 bytes} [Mon Feb 28 18:54:04 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:04.215708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:04.226834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52157c91-1e91-4a78-bbb7-5366dc3bec06 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:04.232048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:04.232692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:04.233042 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:04.233381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:04.241780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:04.268211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:04.276772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1260/2519] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:54:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:54:05.680394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:05.695572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712743c-a857-42a1-bc0e-8d0aa8e3bcec None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:05.701223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:05.701817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:05.702106 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:05.702390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:05.704148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:05.716220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:05.741449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:05.752992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1260/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:05 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:07.006982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:07.008540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:07.099534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f238-05d9-417d-9bb7-6588b1638d6d service swift] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:07.103734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:07.104569 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:07.104853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:07.105467 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] PATH_INFO: `/v3/users/4d92486e607a4eb2adb9d21d740fbbc2` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:07.106351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d92486e607a4eb2adb9d21d740fbbc2)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:07.131902 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:07.195311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d92486e607a4eb2adb9d21d740fbbc2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.205379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d92486e607a4eb2adb9d21d740fbbc2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.216594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d92486e607a4eb2adb9d21d740fbbc2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.217179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d92486e607a4eb2adb9d21d740fbbc2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.217829 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ef3dc93b-4984-4f57-9ddc-b13cec74fb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d92486e607a4eb2adb9d21d740fbbc2'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.246334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1261/2521] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:07 2022] DELETE /identity/v3/users/4d92486e607a4eb2adb9d21d740fbbc2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:07.481035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:07.492497 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8acb44-fb28-4b20-b3af-9bff219ea0d4 service nova] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:07.561420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:07.562317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:07.562630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:07.562915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] PATH_INFO: `/v3/projects/cbf2b9318fb845dab79d447739877511` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:07.564024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf2b9318fb845dab79d447739877511)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:07.590049 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:07.648189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf2b9318fb845dab79d447739877511', 'request_id': 'req-22a9931b-8ace-4465-b858-5f4a912af666'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.653941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf2b9318fb845dab79d447739877511', 'request_id': 'req-22a9931b-8ace-4465-b858-5f4a912af666'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.663344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf2b9318fb845dab79d447739877511', 'request_id': 'req-22a9931b-8ace-4465-b858-5f4a912af666'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.680683 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] The token cache is being invalidate because project cbf2b9318fb845dab79d447739877511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:07.681176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.681906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-22a9931b-8ace-4465-b858-5f4a912af666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:07.683758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1261/2522] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:07 2022] DELETE /identity/v3/projects/cbf2b9318fb845dab79d447739877511 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:07.688671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:07.688966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:07.689244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:07.711524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:07.712667 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:07.778151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1262/2523] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:07.785756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:07.786047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:07.786324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:07.808857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:07.809991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:07.818125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1262/2524] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:07.822634 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:07.832153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2baeb8-79f5-40c0-8761-4c9e17387f7f None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:07.836391 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:07.836981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:07.837268 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:07.837549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:07.838245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:54:07.838546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:07.864090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:07.877802 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1263/2525] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:54:07.884649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:07.899906 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e295d3d-f15b-49bd-8dd3-1354b84805c0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:07.906229 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:07.906977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:07.907267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:07.907543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:07.908185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:07.934118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:07.968131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1263/2526] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:54:07 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:07.972368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:07.982145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99672f-ec86-4aab-86c1-790791a59236 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:08.044848 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:08.045564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:08.045714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:08.046017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:08.046687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:08.073031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:08.095523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1264/2527] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:54:07 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:08.099757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:08.112842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523645-4817-4eff-8ed4-f5f3f248b73b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:08.119778 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16dca-f36d-4003-bed6-95e4998bda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:08.120726 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16dca-f36d-4003-bed6-95e4998bda10 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:08.121013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16dca-f36d-4003-bed6-95e4998bda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:08.121293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16dca-f36d-4003-bed6-95e4998bda10 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:08.121992 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16dca-f36d-4003-bed6-95e4998bda10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:08.147392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16dca-f36d-4003-bed6-95e4998bda10 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:08.158476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1264/2528] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:08.164515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:08.174781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1384a7b-42a7-4357-9215-2e97123ba9c6 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:08.179751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:08.180668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:08.180999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:08.181278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] PATH_INFO: `/v3/projects/b95b856ca8f14b84aed0c15377ac89de/users/d491a9f696e44c16b8fc4feb353494bb/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:08.202061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95b856ca8f14b84aed0c15377ac89de, user_id=d491a9f696e44c16b8fc4feb353494bb, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:08.228284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:08.243924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1265/2529] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:08 2022] PUT /identity/v3/projects/b95b856ca8f14b84aed0c15377ac89de/users/d491a9f696e44c16b8fc4feb353494bb/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:54:08.254520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:08.254841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:08.255119 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:08.291262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] MFA Rules not processed for user `d491a9f696e44c16b8fc4feb353494bb`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:08.292544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:08.381355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1265/2530] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:08 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:08.392030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:08.393988 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:08.469359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816e509-fef5-4ce8-8333-f3b20b652d3a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:08.473609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:08.474221 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:08.474497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:08.474815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:08.484016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:08.509400 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:08.518130 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1266/2531] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:08 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:14.951114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:14.953298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:15.042508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a4bbd-e7bf-4354-8ce4-0c98fd590dc6 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:15.050901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:15.052564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:15.053007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:15.053435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:15.056682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:15.154698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:15.186472 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581f8ec-af06-40b7-bd57-4f036baa5cd0 service nova] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:15.197631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1266/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:14 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:19.646421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:19.725211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe70950-a613-4a39-bb17-f1722604ddf0 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:19.730345 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:19.731303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:19.731542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:19.731854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] PATH_INFO: `/v3/users/d491a9f696e44c16b8fc4feb353494bb` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:19.733240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d491a9f696e44c16b8fc4feb353494bb)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:19.758969 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:19.823783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd491a9f696e44c16b8fc4feb353494bb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:19.832078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd491a9f696e44c16b8fc4feb353494bb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:19.839659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd491a9f696e44c16b8fc4feb353494bb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:19.840446 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd491a9f696e44c16b8fc4feb353494bb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:19.841123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd491a9f696e44c16b8fc4feb353494bb'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:19.858154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1267/2533] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:19 2022] DELETE /identity/v3/users/d491a9f696e44c16b8fc4feb353494bb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:19.862967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:19.863763 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:19.864492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:19.891705 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:19.892960 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:19.969349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1267/2534] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:54:19.980699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:19.982514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:20.056725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe00b3-54b6-4a12-83da-e2ad55cf895a admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:20.061301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:20.061846 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:20.062220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:20.062581 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:20.071879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:20.097691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:20.108748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1268/2535] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:20.635746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:20.637563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:20.650540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1e890-39c4-4e26-9b24-7a8fd6894d25 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:20.655979 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:20.657043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:20.657328 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:20.657606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] PATH_INFO: `/v3/projects/b95b856ca8f14b84aed0c15377ac89de` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:20.658831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95b856ca8f14b84aed0c15377ac89de)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:20.694770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:20.758266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95b856ca8f14b84aed0c15377ac89de', 'request_id': 'req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:20.763261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95b856ca8f14b84aed0c15377ac89de', 'request_id': 'req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:20.772620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95b856ca8f14b84aed0c15377ac89de', 'request_id': 'req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:20.794496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] The token cache is being invalidate because project b95b856ca8f14b84aed0c15377ac89de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:20.795449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:20.796818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1df1ebac-ad7c-44ba-bc32-0de6b9d91ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:20.807413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1268/2536] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:20 2022] DELETE /identity/v3/projects/b95b856ca8f14b84aed0c15377ac89de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:22.667971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:22.679644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2285b-9042-4977-a90b-76228b2d6986 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:22.739494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:22.740170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:22.740575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:22.740860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:22.742770 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:22.813565 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:22.839899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:22.850441 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1269/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:22 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:23.241880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:23.242413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:23.242604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:23.268020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:23.269564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:23.354178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1269/2538] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:54:23 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:23.369985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:23.371792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:23.474457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035a9f4-1385-422b-bce7-1c896e81e5be service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:23.479101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:23.479695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:23.479982 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:23.480521 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:23.489114 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:23.517107 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:23.526285 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1270/2539] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:54:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:54:27.053810 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:27.055880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:27.074783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34006c30-7f44-4e4e-8f85-4410f75c616c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:27.085063 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:27.087260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:27.087751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:27.088280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:27.092858 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:27.386972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:27.443112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee2e9d-32c5-41f6-9c05-6ef4c44d5d7b service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:27.484059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1270/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:32.208363 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:32.211323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:32.228108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e3ba0-27d5-4c7e-9508-191a7da7d0e2 service swift] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:32.232862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:32.233845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:32.235223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:32.235733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:32.237717 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:32.250761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:32.288115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b90f7-12d2-47ba-ae12-64edb69e74e8 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:32.301169 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1271/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:32 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:32.733930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0e63-2d0e-4807-a062-a7e8f4dd2681 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:32.734883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0e63-2d0e-4807-a062-a7e8f4dd2681 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:32.734883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0e63-2d0e-4807-a062-a7e8f4dd2681 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:32.736356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1271/2542] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:32.753691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:32.754590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:32.754590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:32.799017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:32.800974 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:32.815086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1272/2543] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:54:32 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:32.834833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0e63-2d0e-4807-a062-a7e8f4dd2681 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:32.851559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0e63-2d0e-4807-a062-a7e8f4dd2681 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:32.862946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:32.864923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:32.865448 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:32.866265 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:32.878860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:32.962632 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:32.995453 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1272/2544] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:32 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:37.171226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:37.172761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:37.191724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ad5e3-554d-4967-906f-d61012923e05 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:37.197258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:37.198307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:37.198622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:37.199057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] PATH_INFO: `/v3/users/b29711f9ca2e4725b4f702405eb31bd3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:37.200748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29711f9ca2e4725b4f702405eb31bd3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:37.226473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:37.294538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29711f9ca2e4725b4f702405eb31bd3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.303895 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29711f9ca2e4725b4f702405eb31bd3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.319533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29711f9ca2e4725b4f702405eb31bd3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.319803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29711f9ca2e4725b4f702405eb31bd3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.320326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b1f6fd2d-61b5-494c-82ca-47de0990ecc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29711f9ca2e4725b4f702405eb31bd3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.339987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1273/2545] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:37 2022] DELETE /identity/v3/users/b29711f9ca2e4725b4f702405eb31bd3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:37.646255 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:37.665287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c12fc8-c88e-43e6-8090-a6e0c3c3ab04 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:37.820951 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:37.822067 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:37.822536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:37.823034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] PATH_INFO: `/v3/projects/8fcb1c7fbee84c74815b0b125d1f9b35` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:37.826435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcb1c7fbee84c74815b0b125d1f9b35)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:37.854304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:37.948930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcb1c7fbee84c74815b0b125d1f9b35', 'request_id': 'req-cd365962-8bf6-4f53-b124-5a602660b76a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.956866 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcb1c7fbee84c74815b0b125d1f9b35', 'request_id': 'req-cd365962-8bf6-4f53-b124-5a602660b76a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.967921 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcb1c7fbee84c74815b0b125d1f9b35', 'request_id': 'req-cd365962-8bf6-4f53-b124-5a602660b76a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.987536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] The token cache is being invalidate because project 8fcb1c7fbee84c74815b0b125d1f9b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:37.988178 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.989325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-cd365962-8bf6-4f53-b124-5a602660b76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:37.991089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1273/2546] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:37 2022] DELETE /identity/v3/projects/8fcb1c7fbee84c74815b0b125d1f9b35 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:37.995893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7cb1-964f-4898-950b-4235d941deca None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:37.996286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7cb1-964f-4898-950b-4235d941deca None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:37.997139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7cb1-964f-4898-950b-4235d941deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.020928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-394e7cb1-964f-4898-950b-4235d941deca None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:38.022088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-394e7cb1-964f-4898-950b-4235d941deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:38.098863 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1274/2547] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:38.107388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.107689 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.107975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.132028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:38.133210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:38.141046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1274/2548] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:38.145723 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7cb1-964f-4898-950b-4235d941deca None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:38.155815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7cb1-964f-4898-950b-4235d941deca None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:38.160524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:38.161100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.161417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.161696 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.162357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:54:38.162697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:38.200786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:38.225916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1275/2549] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:54:38.231087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:38.240519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b67d-87e7-4e72-9765-b084f676d6a3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:38.246206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:38.246939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.247262 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.247643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.248307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:38.274569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:38.315849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1275/2550] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:54:38 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:38.320586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:38.332436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d92e0-b4f6-45a9-8aa3-ddb3b0576d68 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:38.420643 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:38.421502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.421794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.422077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.422785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:38.449921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:38.475561 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1276/2551] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:54:38 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:38.479587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:38.493473 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcdbe-d276-4155-9f2f-4ec24d159da4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:38.499034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eec05-5d8c-490a-b4c8-d573ed1c6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:38.499861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eec05-5d8c-490a-b4c8-d573ed1c6b15 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.500303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eec05-5d8c-490a-b4c8-d573ed1c6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.500576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eec05-5d8c-490a-b4c8-d573ed1c6b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.501420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eec05-5d8c-490a-b4c8-d573ed1c6b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:38.527845 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eec05-5d8c-490a-b4c8-d573ed1c6b15 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:38.543175 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1276/2552] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:38.544438 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:38.556422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf637eb-57d4-4274-8ca9-921564dfca43 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:38.561530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:38.562390 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.562715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.563003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] PATH_INFO: `/v3/projects/74e0e8699a254217bcd7f9c624688f40/users/a968712348824ba8bb9e27748950aae8/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.584336 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e0e8699a254217bcd7f9c624688f40, user_id=a968712348824ba8bb9e27748950aae8, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:38.611113 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:38.627305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1277/2553] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:38 2022] PUT /identity/v3/projects/74e0e8699a254217bcd7f9c624688f40/users/a968712348824ba8bb9e27748950aae8/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:38.639177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532da7-2172-45e5-af78-9e1b623369a2 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.639641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532da7-2172-45e5-af78-9e1b623369a2 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.640018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532da7-2172-45e5-af78-9e1b623369a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.788043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-99532da7-2172-45e5-af78-9e1b623369a2 None None] MFA Rules not processed for user `a968712348824ba8bb9e27748950aae8`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:38.789280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-99532da7-2172-45e5-af78-9e1b623369a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:38.874619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1277/2554] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:38 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:54:38.882602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:38.884301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:38.975703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c998f-b964-4746-b39e-b03f7c8b06a0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:38.986031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73a3eb-127f-4ff9-9aa3-26955d476d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:38.988892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a3eb-127f-4ff9-9aa3-26955d476d95 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:38.988892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a3eb-127f-4ff9-9aa3-26955d476d95 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:38.988892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73a3eb-127f-4ff9-9aa3-26955d476d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:38.996426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73a3eb-127f-4ff9-9aa3-26955d476d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:39.022711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73a3eb-127f-4ff9-9aa3-26955d476d95 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:39.033192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1278/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:38 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:48.789813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a61ec-4ae3-4b95-9264-9c454b58d604 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:48.790385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a61ec-4ae3-4b95-9264-9c454b58d604 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:48.790385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a61ec-4ae3-4b95-9264-9c454b58d604 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:48.792142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1278/2556] 10.222.0.18 () {54 vars in 921 bytes} [Mon Feb 28 18:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:54:48.797504 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:48.797928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:48.798119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:48.822165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] MFA Rules not processed for user `05012414e8a946fcbbaef5a317a19433`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:48.823359 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:48.884756 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1279/2557] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Feb 28 18:54:48 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:48.897713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a61ec-4ae3-4b95-9264-9c454b58d604 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:48.899323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d88a61ec-4ae3-4b95-9264-9c454b58d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:48.912302 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a61ec-4ae3-4b95-9264-9c454b58d604 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:48.916166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d11e4-0406-4792-9f32-98c1f0135072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:48.916731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d11e4-0406-4792-9f32-98c1f0135072 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:48.917019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d11e4-0406-4792-9f32-98c1f0135072 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:48.917314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d11e4-0406-4792-9f32-98c1f0135072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:48.925082 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d11e4-0406-4792-9f32-98c1f0135072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:48.950363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d11e4-0406-4792-9f32-98c1f0135072 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:48.958825 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1279/2558] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:48 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:49.287774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:49.374685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ff357-e3b9-4693-b9f3-8772853525d4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:49.379944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:49.380942 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:49.381263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:49.381523 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] PATH_INFO: `/v3/users/a968712348824ba8bb9e27748950aae8` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:49.383200 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a968712348824ba8bb9e27748950aae8)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:49.409261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:49.462994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a968712348824ba8bb9e27748950aae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:49.471061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a968712348824ba8bb9e27748950aae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:49.480259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a968712348824ba8bb9e27748950aae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:49.481077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a968712348824ba8bb9e27748950aae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:49.481779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a968712348824ba8bb9e27748950aae8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:49.500617 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1280/2559] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:49 2022] DELETE /identity/v3/users/a968712348824ba8bb9e27748950aae8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:49.505055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:49.505349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:49.505630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:49.528986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:49.530267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:49.602697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1280/2560] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:49.611713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:49.613317 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:49.686181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fb71d-11be-4d7c-b7ff-212f3391d140 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:49.690937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cc5ed-98d4-4dde-89d1-d30ee1346c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:49.691647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cc5ed-98d4-4dde-89d1-d30ee1346c01 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:49.692037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cc5ed-98d4-4dde-89d1-d30ee1346c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:49.692413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cc5ed-98d4-4dde-89d1-d30ee1346c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:49.702321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cc5ed-98d4-4dde-89d1-d30ee1346c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:49.731599 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cc5ed-98d4-4dde-89d1-d30ee1346c01 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:49.741958 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1281/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:49 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:50.171771 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:50.175671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:50.201029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97091e-7a0b-43f9-b80a-6886b2d8d7a4 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:50.209018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:50.210299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.210802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.211334 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] PATH_INFO: `/v3/projects/74e0e8699a254217bcd7f9c624688f40` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.213198 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e0e8699a254217bcd7f9c624688f40)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:50.252257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:50.346907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e0e8699a254217bcd7f9c624688f40', 'request_id': 'req-b5475f83-c3af-4f43-8338-1df1d24f19f9'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:50.353202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e0e8699a254217bcd7f9c624688f40', 'request_id': 'req-b5475f83-c3af-4f43-8338-1df1d24f19f9'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:50.364671 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e0e8699a254217bcd7f9c624688f40', 'request_id': 'req-b5475f83-c3af-4f43-8338-1df1d24f19f9'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:50.385782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] The token cache is being invalidate because project 74e0e8699a254217bcd7f9c624688f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:50.386075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:50.386724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b5475f83-c3af-4f43-8338-1df1d24f19f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:50.388268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1281/2562] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:50 2022] DELETE /identity/v3/projects/74e0e8699a254217bcd7f9c624688f40 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:50.395026 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.395542 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.395636 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.419385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:50.420528 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:50.489842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1282/2563] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:50.497797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.498161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.498532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.521924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:50.523129 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:50.530163 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1282/2564] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:50.535265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:50.544321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba1cf5-9f11-4c18-875b-403b105fb1c5 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:50.549353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:50.549941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.550220 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.550493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.551212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:54:50.551502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:50.577695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:50.591225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1283/2565] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:54:50.596340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:50.605609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b2475-61e2-46d9-8e6b-fa10c3035c9b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:50.610612 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:50.611228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.611493 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.611768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.612404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:50.637822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:50.678738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1283/2566] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:54:50 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:50.680007 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:50.691656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e134ee4-e57e-498d-ad80-69c65c1d2f45 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:50.755608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:50.756224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.756510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.756789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.757427 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:50.783726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:50.807874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1284/2567] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:54:50 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:50.809058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:50.819603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b38638-b325-45ed-879d-5d13a345598b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:50.824564 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49063e64-fced-453a-a671-bd4993fcc5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:50.825403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063e64-fced-453a-a671-bd4993fcc5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.825691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063e64-fced-453a-a671-bd4993fcc5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.826020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49063e64-fced-453a-a671-bd4993fcc5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.826893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49063e64-fced-453a-a671-bd4993fcc5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:50.853413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49063e64-fced-453a-a671-bd4993fcc5e2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:50.867738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1284/2568] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:54:50.868891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:50.878793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d21a-30fd-4e6b-9660-9c9fa5364266 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:50.882941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:50.883816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.884104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.884382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] PATH_INFO: `/v3/projects/be03599cbd7246a1bee917caf4aff9c6/users/f29cc309f4264cc6884dd860b6a05ecd/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:50.906172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be03599cbd7246a1bee917caf4aff9c6, user_id=f29cc309f4264cc6884dd860b6a05ecd, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:50.937803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:50.956619 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1285/2569] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:50 2022] PUT /identity/v3/projects/be03599cbd7246a1bee917caf4aff9c6/users/f29cc309f4264cc6884dd860b6a05ecd/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:50.968317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:50.968733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:50.969640 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.010594 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] MFA Rules not processed for user `f29cc309f4264cc6884dd860b6a05ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:51.011696 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:51.099167 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1285/2570] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:50 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:51.103898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.175862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade436-177f-44d8-801b-c2fba881433c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.180607 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21394-154e-429c-ab8c-352d1c43459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.181248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21394-154e-429c-ab8c-352d1c43459c admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.181557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21394-154e-429c-ab8c-352d1c43459c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.181825 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21394-154e-429c-ab8c-352d1c43459c admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.182539 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21394-154e-429c-ab8c-352d1c43459c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.209346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21394-154e-429c-ab8c-352d1c43459c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.239991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1286/2571] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:54:51 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:51.244143 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.254868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650222f-9a09-47b5-b758-3bb8fd7b8f4c None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.325211 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.325867 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.327673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.327673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.327673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.352179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.352474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.352758 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.359423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.378232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:51.382103 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:51.387756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1286/2572] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:54:51 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:51.391268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.401196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092363c-2aae-4a01-838c-34a23b9b03b3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.406693 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.407738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.408283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.408881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.409734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.436941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.449503 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1287/2573] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:54:51.454494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.460142 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1287/2574] 10.222.0.18 () {58 vars in 1014 bytes} [Mon Feb 28 18:54:51 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:54:51.472687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164b1c0-44d2-416a-ae9a-3923dc34242b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.475259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.476960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:51.478852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.480131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.480779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.481270 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] PATH_INFO: `/v3/projects/da29071e88264aa2a4021fa86bb20a07/users/b24e1a1ef0a14b5192700aa727cffb1a/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.504020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da29071e88264aa2a4021fa86bb20a07, user_id=b24e1a1ef0a14b5192700aa727cffb1a, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.533076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.553724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1288/2575] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:51 2022] PUT /identity/v3/projects/da29071e88264aa2a4021fa86bb20a07/users/b24e1a1ef0a14b5192700aa727cffb1a/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:51.558383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.562001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b9f4-2d36-4192-98f3-da707526e961 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.644411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d42573-9909-493d-bd0f-dfe8bd4bba26 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.657422 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.658386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.658727 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.659075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.659838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.671111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.673708 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.674211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.674666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.693331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.706518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1289/2576] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:51.710829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.721260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d315-be76-4134-b2e0-cd4f31ae6b50 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.742619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.743489 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.743744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.744021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] PATH_INFO: `/v3/projects/da29071e88264aa2a4021fa86bb20a07/users/b24e1a1ef0a14b5192700aa727cffb1a/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.745886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da29071e88264aa2a4021fa86bb20a07, user_id=b24e1a1ef0a14b5192700aa727cffb1a, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.756368 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.773636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.783805 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.785878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1290/2577] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:51 2022] PUT /identity/v3/projects/da29071e88264aa2a4021fa86bb20a07/users/b24e1a1ef0a14b5192700aa727cffb1a/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:54:51.791068 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.794242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1288/2578] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:54:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:54:51.883529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614b860-6cd1-4ea9-8027-8c246851028a admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.888559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042550f5-6f7c-4e92-9fa6-4472992df9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.889396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042550f5-6f7c-4e92-9fa6-4472992df9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.890012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042550f5-6f7c-4e92-9fa6-4472992df9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.890420 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042550f5-6f7c-4e92-9fa6-4472992df9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.892125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042550f5-6f7c-4e92-9fa6-4472992df9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.926957 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042550f5-6f7c-4e92-9fa6-4472992df9d8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:51.940236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1291/2579] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:51.944418 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:51.956997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4300a5-dc0d-4d8f-a3d5-195d90db5641 service swift] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:51.964237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:51.965759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:51.966286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:51.966759 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] PATH_INFO: `/v3/projects/da29071e88264aa2a4021fa86bb20a07/users/b24e1a1ef0a14b5192700aa727cffb1a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:51.969136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da29071e88264aa2a4021fa86bb20a07, user_id=b24e1a1ef0a14b5192700aa727cffb1a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:51.999985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:52.028761 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1289/2580] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:51 2022] PUT /identity/v3/projects/da29071e88264aa2a4021fa86bb20a07/users/b24e1a1ef0a14b5192700aa727cffb1a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:52.038846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:52.039148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:52.039430 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:52.084279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] MFA Rules not processed for user `b24e1a1ef0a14b5192700aa727cffb1a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:52.085623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:52.180116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1292/2581] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:52 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:52.190671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:52.192324 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:52.293217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5da49-7ebc-4829-bbdc-ae4d7d2f7fc0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:52.298115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb109f-b0dd-4487-a9cf-ee0e89042576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:52.299487 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb109f-b0dd-4487-a9cf-ee0e89042576 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:52.299979 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb109f-b0dd-4487-a9cf-ee0e89042576 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:52.300412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb109f-b0dd-4487-a9cf-ee0e89042576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:52.314192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb109f-b0dd-4487-a9cf-ee0e89042576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:52.348592 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb109f-b0dd-4487-a9cf-ee0e89042576 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:52.358887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1290/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:52 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:54.297567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:54.375536 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c66487-728f-408b-813c-eb92c6689758 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:54.380721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:54.381708 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:54.382112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:54.382508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] PATH_INFO: `/v3/users/f29cc309f4264cc6884dd860b6a05ecd` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:54.385322 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29cc309f4264cc6884dd860b6a05ecd)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:54.411938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:54.466567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29cc309f4264cc6884dd860b6a05ecd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:54.478770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29cc309f4264cc6884dd860b6a05ecd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:54.479508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29cc309f4264cc6884dd860b6a05ecd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:54.493064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29cc309f4264cc6884dd860b6a05ecd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:54.501275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29cc309f4264cc6884dd860b6a05ecd'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:54.516477 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1293/2583] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:54 2022] DELETE /identity/v3/users/f29cc309f4264cc6884dd860b6a05ecd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:54.519077 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:54.519615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:54.519615 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:54.554098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:54.555586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:54.666777 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1291/2584] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:54.675009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:54.677043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:54.788456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38cbf-0a5d-4fc1-8d18-179129e58bef admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:54.792572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:54.793278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:54.793744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:54.794085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:54.806664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:54.842101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:54.865018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1294/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:55.329190 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:55.331715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:55.343154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b824-e31c-4e11-a9f5-36412d44ae23 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:55.352953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:55.353836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:55.354192 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:55.354609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] PATH_INFO: `/v3/projects/be03599cbd7246a1bee917caf4aff9c6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:55.355867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be03599cbd7246a1bee917caf4aff9c6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:55.385594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:55.462423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be03599cbd7246a1bee917caf4aff9c6', 'request_id': 'req-804e1c17-c0a1-45a6-94c7-8cb043dfae51'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.467365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be03599cbd7246a1bee917caf4aff9c6', 'request_id': 'req-804e1c17-c0a1-45a6-94c7-8cb043dfae51'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.476425 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be03599cbd7246a1bee917caf4aff9c6', 'request_id': 'req-804e1c17-c0a1-45a6-94c7-8cb043dfae51'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.503454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] The token cache is being invalidate because project be03599cbd7246a1bee917caf4aff9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:55.503725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.504362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.506037 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1292/2586] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:55 2022] DELETE /identity/v3/projects/be03599cbd7246a1bee917caf4aff9c6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:55.510310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:55.531576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e341f-20dd-4570-ae82-347a7d9004d9 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:55.587669 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:55.588480 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:55.588766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:55.589077 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] PATH_INFO: `/v3/users/b24e1a1ef0a14b5192700aa727cffb1a` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:55.590160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24e1a1ef0a14b5192700aa727cffb1a)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:55.615916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:55.673151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24e1a1ef0a14b5192700aa727cffb1a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.682909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24e1a1ef0a14b5192700aa727cffb1a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.683504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24e1a1ef0a14b5192700aa727cffb1a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.698777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24e1a1ef0a14b5192700aa727cffb1a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.707116 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-405ecc59-05b2-4fd1-afc5-52658d82d791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24e1a1ef0a14b5192700aa727cffb1a'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:55.713406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1295/2587] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:55 2022] DELETE /identity/v3/users/b24e1a1ef0a14b5192700aa727cffb1a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:56.222202 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:56.225176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:56.238855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e1c17-c0a1-45a6-94c7-8cb043dfae51 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:56.309884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:56.311098 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.311515 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.311897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] PATH_INFO: `/v3/projects/da29071e88264aa2a4021fa86bb20a07` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.313136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da29071e88264aa2a4021fa86bb20a07)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:56.338737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:56.398270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da29071e88264aa2a4021fa86bb20a07', 'request_id': 'req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:56.404408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da29071e88264aa2a4021fa86bb20a07', 'request_id': 'req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:56.435009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da29071e88264aa2a4021fa86bb20a07', 'request_id': 'req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:56.449864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] The token cache is being invalidate because project da29071e88264aa2a4021fa86bb20a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:56.450152 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:56.450835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-49155cd7-aa1b-49c3-ac76-c11a7ed6a207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:56.452575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1293/2588] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:56 2022] DELETE /identity/v3/projects/da29071e88264aa2a4021fa86bb20a07 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:56.458016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.458313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.458638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.483132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:56.484481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:56.560929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1296/2589] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:56.562713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.563017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.563303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.595249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:56.596443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:56.603688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1294/2590] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:56.608078 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:56.617973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032985f-c875-4d89-a084-4a9a454cd797 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:56.622795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:56.623543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.623828 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.624108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.624802 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:54:56.625706 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:56.652911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:56.668110 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1297/2591] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:54:56.672385 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:56.695545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb8914-a7f9-4c78-9b50-a20cf4ab7ab1 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:56.706854 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:56.708086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.708086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.708086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.708674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:56.749697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:56.782875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1295/2592] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:54:56 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:56.786650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:56.797014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86f684-ea8a-4372-bcfd-7c91403e08b3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:56.875390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:56.876000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.876283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.876559 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.877202 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:56.902937 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:56.924953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1298/2593] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:54:56 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:56.929255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:56.940460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1a743-67be-4fd0-a17b-a4434df60ecf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:56.945182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8b999-ca15-4693-81f8-e0e5aea4c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:56.945795 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b999-ca15-4693-81f8-e0e5aea4c1ca admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:56.946090 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b999-ca15-4693-81f8-e0e5aea4c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:56.946376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8b999-ca15-4693-81f8-e0e5aea4c1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:56.947123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8b999-ca15-4693-81f8-e0e5aea4c1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:56.973233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8b999-ca15-4693-81f8-e0e5aea4c1ca admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:56.987543 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1296/2594] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:56.988909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:56.999087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3a0ad-1f2c-47cf-974e-9c94bcd53bea admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.003681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.004506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.004792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.005070 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] PATH_INFO: `/v3/projects/aae36ab371294f7c8fac4b055dd5873b/users/58df24133c29473084867a5aaca42558/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.025436 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae36ab371294f7c8fac4b055dd5873b, user_id=58df24133c29473084867a5aaca42558, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.052159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.070426 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1299/2595] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:56 2022] PUT /identity/v3/projects/aae36ab371294f7c8fac4b055dd5873b/users/58df24133c29473084867a5aaca42558/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:57.082034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.082332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.082718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.223883 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] MFA Rules not processed for user `58df24133c29473084867a5aaca42558`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:57.225361 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:57.311432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1297/2596] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:57 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:57.316047 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.411462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2170dc0-721c-4557-9281-7a937e112fe9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.416599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.416788 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.416942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.417219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.417885 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.462886 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.497539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1300/2597] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:54:57 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:57.506735 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.513178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed453ce9-59f8-4173-b61c-4bb33879b0e9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.579080 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.579674 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.579955 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.580232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.580867 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.610618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.636230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1298/2598] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:54:57 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:54:57.640281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.650826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74c769-f47b-441f-9eb4-9aa07450ef5e admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.655159 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.655768 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.656054 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.656379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.657277 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.682861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.695452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1301/2599] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:54:57.699618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.710715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51a496-cbb2-4edf-8966-ae12b68d6984 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.716966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.718350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.718901 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.719587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] PATH_INFO: `/v3/projects/914011cf17da46748bfebe82e335eff6/users/85af6ded0f7e4f0083daf23564ef1ed4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.747177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914011cf17da46748bfebe82e335eff6, user_id=85af6ded0f7e4f0083daf23564ef1ed4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.773656 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.794238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1299/2600] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:57 2022] PUT /identity/v3/projects/914011cf17da46748bfebe82e335eff6/users/85af6ded0f7e4f0083daf23564ef1ed4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:57.795737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.806976 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a6d8-e7fe-4772-8730-0560a4ca86a5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.881019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.881996 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.882414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.882787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.883642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.912463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:57.923458 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1302/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:57.927609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:57.939203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c37d-4c4b-476a-999e-697396bbbf69 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:57.943880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:57.944729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:57.945014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:57.945488 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] PATH_INFO: `/v3/projects/914011cf17da46748bfebe82e335eff6/users/85af6ded0f7e4f0083daf23564ef1ed4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:57.958689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914011cf17da46748bfebe82e335eff6, user_id=85af6ded0f7e4f0083daf23564ef1ed4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:57.990240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:58.001420 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1300/2602] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:57 2022] PUT /identity/v3/projects/914011cf17da46748bfebe82e335eff6/users/85af6ded0f7e4f0083daf23564ef1ed4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:58.005562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:58.017014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171210-ac46-4871-83e1-94298caed8c0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:58.096566 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba2169-5287-43d0-a1ab-1ffce508a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:58.098140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba2169-5287-43d0-a1ab-1ffce508a87a admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.098140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba2169-5287-43d0-a1ab-1ffce508a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.098140 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba2169-5287-43d0-a1ab-1ffce508a87a admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.098464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba2169-5287-43d0-a1ab-1ffce508a87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:58.129203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba2169-5287-43d0-a1ab-1ffce508a87a admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:58.148331 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1303/2603] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:54:58.149779 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:58.160827 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce526a-1e81-40da-9d6f-3cb31d373ba2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:58.166123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:58.167242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.167849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.168299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] PATH_INFO: `/v3/projects/914011cf17da46748bfebe82e335eff6/users/85af6ded0f7e4f0083daf23564ef1ed4/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.170310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914011cf17da46748bfebe82e335eff6, user_id=85af6ded0f7e4f0083daf23564ef1ed4, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:58.199104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:58.221329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1301/2604] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:54:58 2022] PUT /identity/v3/projects/914011cf17da46748bfebe82e335eff6/users/85af6ded0f7e4f0083daf23564ef1ed4/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:58.231439 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.231743 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.232015 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.282880 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] MFA Rules not processed for user `85af6ded0f7e4f0083daf23564ef1ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:58.285583 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:58.371002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1304/2605] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:58 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:58.377746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:58.379506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:58.454017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b64c-0edd-4e8f-a954-c15aba852e50 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:58.458004 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c284aa6-eb03-43eb-a251-ff20ba156aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:58.458631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284aa6-eb03-43eb-a251-ff20ba156aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.458921 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284aa6-eb03-43eb-a251-ff20ba156aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.459320 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c284aa6-eb03-43eb-a251-ff20ba156aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.470225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c284aa6-eb03-43eb-a251-ff20ba156aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:58.495976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c284aa6-eb03-43eb-a251-ff20ba156aa7 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:58.508239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1302/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:58 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:54:58.535309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:58.615910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bf3d9-dd9b-46a5-8f14-73c5cede9803 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:58.620883 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:58.621936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.622411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.622730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] PATH_INFO: `/v3/users/58df24133c29473084867a5aaca42558` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.623939 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=58df24133c29473084867a5aaca42558)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:58.651150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:58.712864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58df24133c29473084867a5aaca42558'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:58.724196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58df24133c29473084867a5aaca42558'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:58.725355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58df24133c29473084867a5aaca42558'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:58.740176 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58df24133c29473084867a5aaca42558'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:58.748609 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58df24133c29473084867a5aaca42558'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:58.757545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1305/2607] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:58 2022] DELETE /identity/v3/users/58df24133c29473084867a5aaca42558 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:58.762678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.762978 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.763279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.804291 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:54:58.805510 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:58.875903 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1303/2608] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:54:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:54:58.886026 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:58.887385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:58.954137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cc959-7d5b-4320-97da-44e43f34f1aa admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:58.957576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:58.958189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:58.958482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:58.958781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:58.978826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:59.004028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:59.014249 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1306/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:54:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:54:59.515992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:59.519729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:54:59.555906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08032ed7-2591-42c0-8b7d-5160b99fff6b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:59.569133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:59.569939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:59.570172 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:59.570694 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] PATH_INFO: `/v3/projects/aae36ab371294f7c8fac4b055dd5873b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:59.574283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae36ab371294f7c8fac4b055dd5873b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:59.600040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:59.654699 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae36ab371294f7c8fac4b055dd5873b', 'request_id': 'req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.660738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae36ab371294f7c8fac4b055dd5873b', 'request_id': 'req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.670727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae36ab371294f7c8fac4b055dd5873b', 'request_id': 'req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.689546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] The token cache is being invalidate because project aae36ab371294f7c8fac4b055dd5873b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:54:59.689851 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.690460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.692228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1304/2610] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:54:59 2022] DELETE /identity/v3/projects/aae36ab371294f7c8fac4b055dd5873b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:54:59.699641 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:54:59.709386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74d06-4143-436e-8a5b-a91b81914cc3 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:54:59.779074 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:54:59.780714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:54:59.781075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:54:59.782200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] PATH_INFO: `/v3/users/85af6ded0f7e4f0083daf23564ef1ed4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:54:59.784283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85af6ded0f7e4f0083daf23564ef1ed4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:54:59.811304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:54:59.884146 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85af6ded0f7e4f0083daf23564ef1ed4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.894304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85af6ded0f7e4f0083daf23564ef1ed4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.895200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85af6ded0f7e4f0083daf23564ef1ed4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.921966 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85af6ded0f7e4f0083daf23564ef1ed4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.931203 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05e4fabb-a723-4458-9dd1-8aa70c9b2115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85af6ded0f7e4f0083daf23564ef1ed4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:54:59.939267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1307/2611] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:54:59 2022] DELETE /identity/v3/users/85af6ded0f7e4f0083daf23564ef1ed4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:55:00.379610 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.381853 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:00.397989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f5985-8d15-41b5-bd8d-d147c8fb8a29 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.466473 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.467396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.467753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.468129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] PATH_INFO: `/v3/projects/914011cf17da46748bfebe82e335eff6` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.469509 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=914011cf17da46748bfebe82e335eff6)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:00.496147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:00.550709 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914011cf17da46748bfebe82e335eff6', 'request_id': 'req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:00.555493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914011cf17da46748bfebe82e335eff6', 'request_id': 'req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:00.564362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914011cf17da46748bfebe82e335eff6', 'request_id': 'req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:00.581908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] The token cache is being invalidate because project 914011cf17da46748bfebe82e335eff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:00.582151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:00.582822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-56fdc3f5-15ad-4bc4-868c-c5bf13d462ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:00.588559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1305/2612] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:00 2022] DELETE /identity/v3/projects/914011cf17da46748bfebe82e335eff6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:00.590225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.590791 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.591216 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.623981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:00.625259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:00.698242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1308/2613] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:00.705894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.706544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.707013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.742695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:00.744162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:00.754095 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1306/2614] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:00.758441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.769856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ec16b-26ce-4514-abe0-f62f258b5dc5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.774582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.775285 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.775642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.775989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.777091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:55:00.777464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:00.809172 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:00.824362 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1309/2615] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:00.828483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.837753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e73040-741c-4d85-9e0b-e6c3ccfd5c07 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.844685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.846068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.846772 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.847245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.847888 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:00.875644 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:00.911987 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1307/2616] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:00 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:55:00.916201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:00.926576 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846effc-02f3-47db-8c7c-beacf4cc2731 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:00.995404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:00.996073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:00.996361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:00.996717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:00.997463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.024040 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.047099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1310/2617] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:00 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:01.051232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.064091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d4b69-b86a-4716-9ad6-9b4ffd6222fe admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.069660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bb97-9c4d-4581-a989-0f4948ec79f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.070277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb97-9c4d-4581-a989-0f4948ec79f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.070586 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb97-9c4d-4581-a989-0f4948ec79f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.070886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb97-9c4d-4581-a989-0f4948ec79f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.071597 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb97-9c4d-4581-a989-0f4948ec79f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.097782 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb97-9c4d-4581-a989-0f4948ec79f9 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.113743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1308/2618] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:01.114405 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.124617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b15dc-0025-4f41-92d9-603a5eb01f81 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.129884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.131061 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.131553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.132032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] PATH_INFO: `/v3/projects/7b7a13d97c6e4aa79d840a3b1ad7fd8b/users/3d55f253cc50432e889de0e08d542831/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.153373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7a13d97c6e4aa79d840a3b1ad7fd8b, user_id=3d55f253cc50432e889de0e08d542831, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.182344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.211085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1311/2619] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:01 2022] PUT /identity/v3/projects/7b7a13d97c6e4aa79d840a3b1ad7fd8b/users/3d55f253cc50432e889de0e08d542831/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:55:01.223296 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.223785 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.224233 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.292604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] MFA Rules not processed for user `3d55f253cc50432e889de0e08d542831`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:01.294262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:01.382778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1309/2620] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:01 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:01.385792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.461333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad0898-a631-4367-8196-7fa329d0bfb7 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.465571 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.466174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.466452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.466757 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.467393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.494963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.524942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1312/2621] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:01 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:01.528966 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.540249 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7805-96f7-4f98-a37d-dbbf10d82034 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.606101 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.606875 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.606981 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.607211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.607842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.635356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.662365 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1310/2622] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:01 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:01.663698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.674210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606e5eb-6ccf-4f61-a414-ee78601439be admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.678928 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.679400 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.679688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.679967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.680761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.706545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.718158 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1313/2623] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:01.724893 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.741545 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e5f2d-938d-4ab5-a2d1-7badaa575a93 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.750191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.751079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.751387 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.751654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] PATH_INFO: `/v3/projects/6e67939f6ca440b29afa1813b90c29f3/users/fea8f0af710549c0bdc94a3f32b35cd4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.773121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e67939f6ca440b29afa1813b90c29f3, user_id=fea8f0af710549c0bdc94a3f32b35cd4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.799482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.816629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1311/2624] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:01 2022] PUT /identity/v3/projects/6e67939f6ca440b29afa1813b90c29f3/users/fea8f0af710549c0bdc94a3f32b35cd4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:55:01.820800 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.830377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16717da-e5e2-4128-bff0-5bd9d0a51e2f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.923567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.924181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.924463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.924746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.925476 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:01.951320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:01.961783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1314/2625] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:01.966199 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:01.976429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d247-b32c-4e4a-8146-e751309eed16 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:01.980732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:01.981552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:01.981840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:01.982243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] PATH_INFO: `/v3/projects/6e67939f6ca440b29afa1813b90c29f3/users/fea8f0af710549c0bdc94a3f32b35cd4/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:01.984332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e67939f6ca440b29afa1813b90c29f3, user_id=fea8f0af710549c0bdc94a3f32b35cd4, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:02.010461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.022300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1312/2626] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:01 2022] PUT /identity/v3/projects/6e67939f6ca440b29afa1813b90c29f3/users/fea8f0af710549c0bdc94a3f32b35cd4/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:02.026287 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.036346 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf858-acac-467e-8678-9ad1cd40d765 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.100338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217cc52-8562-4f6e-a533-e0990826e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.100956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217cc52-8562-4f6e-a533-e0990826e09d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.101238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217cc52-8562-4f6e-a533-e0990826e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.101519 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217cc52-8562-4f6e-a533-e0990826e09d admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.102219 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217cc52-8562-4f6e-a533-e0990826e09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:02.127227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217cc52-8562-4f6e-a533-e0990826e09d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.142989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1315/2627] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:02.148032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.158750 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6fb7c-51dd-4a46-a44b-f9461987f99d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.163497 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.164326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.164612 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.164891 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] PATH_INFO: `/v3/projects/6e67939f6ca440b29afa1813b90c29f3/users/fea8f0af710549c0bdc94a3f32b35cd4/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.166747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e67939f6ca440b29afa1813b90c29f3, user_id=fea8f0af710549c0bdc94a3f32b35cd4, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:02.195091 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.210457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1313/2628] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:02 2022] PUT /identity/v3/projects/6e67939f6ca440b29afa1813b90c29f3/users/fea8f0af710549c0bdc94a3f32b35cd4/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:02.220924 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.221280 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.221563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.258511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] MFA Rules not processed for user `fea8f0af710549c0bdc94a3f32b35cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:02.259714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:02.348592 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1316/2629] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:02 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:02.359985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.362143 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:02.436876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a405629-8727-47a8-a6f1-54cabff12014 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.441726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.442325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.442629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.442913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.452778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:02.478013 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.487944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1314/2630] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:02.868385 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.877668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d807-0894-477e-8599-bdfad5f61b9b None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.883582 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea8f0af710549c0bdc94a3f32b35cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e67939f6ca440b29afa1813b90c29f3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.884170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.884460 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.884740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.885433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:55:02.885736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:02.911967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:02.927013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1317/2631] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:02.931533 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:02.940925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f731e-9223-44b1-bf3d-d8302a2daff3 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:02.945557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea8f0af710549c0bdc94a3f32b35cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e67939f6ca440b29afa1813b90c29f3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:02.946177 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:02.946475 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:02.946793 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:02.947430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:02.973024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:03.006934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1315/2632] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:02 2022] POST /identity/v3/projects => generated 354 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:03.013644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:03.024941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acd61d-460b-4f24-bdfe-11483fb42203 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:03.088941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea8f0af710549c0bdc94a3f32b35cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e67939f6ca440b29afa1813b90c29f3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:03.089556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:03.089868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:03.090234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:03.091314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:55:03.091697 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:03.124006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:03.140508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1318/2633] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:03.184948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:03.197737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071490db-8e85-4de4-aa3f-9539d7c58df6 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:03.202788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fea8f0af710549c0bdc94a3f32b35cd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e67939f6ca440b29afa1813b90c29f3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:03.203662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:03.204089 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:03.204498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] PATH_INFO: `/v3/projects/0b02107922db4e67b2d2b82df98d8ea5` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:03.205698 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b02107922db4e67b2d2b82df98d8ea5)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:03.231732 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:03.284753 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b02107922db4e67b2d2b82df98d8ea5', 'request_id': 'req-34a8a5ea-517c-4633-abdc-274445b9fbf5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.290195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b02107922db4e67b2d2b82df98d8ea5', 'request_id': 'req-34a8a5ea-517c-4633-abdc-274445b9fbf5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.298822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b02107922db4e67b2d2b82df98d8ea5', 'request_id': 'req-34a8a5ea-517c-4633-abdc-274445b9fbf5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.315060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] The token cache is being invalidate because project 0b02107922db4e67b2d2b82df98d8ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:03.315343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.315962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34a8a5ea-517c-4633-abdc-274445b9fbf5 tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.318138 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1316/2634] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:03 2022] DELETE /identity/v3/projects/0b02107922db4e67b2d2b82df98d8ea5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:03.583215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:03.585023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:03.659508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783191-4551-4655-8a10-197ee3ed3dfc tempest-VolumeQuotaClassesTest-288809263 tempest-VolumeQuotaClassesTest-288809263-project-admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:03.724970 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:03.725663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:03.725953 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:03.726668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] PATH_INFO: `/v3/users/3d55f253cc50432e889de0e08d542831` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:03.727831 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d55f253cc50432e889de0e08d542831)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:03.753868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:03.807517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d55f253cc50432e889de0e08d542831'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.818376 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d55f253cc50432e889de0e08d542831'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.819076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d55f253cc50432e889de0e08d542831'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.832410 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d55f253cc50432e889de0e08d542831'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.840742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d55f253cc50432e889de0e08d542831'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:03.847680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1319/2635] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:55:03 2022] DELETE /identity/v3/users/3d55f253cc50432e889de0e08d542831 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:03.852316 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:03.852823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:03.853182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:03.877049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:03.878326 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:03.952297 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1317/2636] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:03.963291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:03.965350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:04.043478 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893aefdb-c074-4353-9321-2bc40393be4f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:04.048604 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:04.049185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.049466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.049736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.060769 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:04.086702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:04.096509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1320/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:04.544170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:04.545797 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:04.561223 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7ffdf-c022-41bf-9bf1-f1172fa65833 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:04.566493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:04.567383 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.567734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.568072 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] PATH_INFO: `/v3/projects/7b7a13d97c6e4aa79d840a3b1ad7fd8b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.569302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7a13d97c6e4aa79d840a3b1ad7fd8b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:04.596381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:04.653243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7a13d97c6e4aa79d840a3b1ad7fd8b', 'request_id': 'req-7f92ee7f-c802-44b2-9645-32eba083ed05'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.658720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7a13d97c6e4aa79d840a3b1ad7fd8b', 'request_id': 'req-7f92ee7f-c802-44b2-9645-32eba083ed05'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.666835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7a13d97c6e4aa79d840a3b1ad7fd8b', 'request_id': 'req-7f92ee7f-c802-44b2-9645-32eba083ed05'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.683239 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] The token cache is being invalidate because project 7b7a13d97c6e4aa79d840a3b1ad7fd8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:04.683522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.684148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.685920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1318/2638] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:04 2022] DELETE /identity/v3/projects/7b7a13d97c6e4aa79d840a3b1ad7fd8b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:04.690220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:04.699513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f88197-28b0-4705-867c-c97c97cc5fcc service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:04.764382 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:04.765120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:04.765404 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:04.765682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] PATH_INFO: `/v3/users/fea8f0af710549c0bdc94a3f32b35cd4` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:04.766838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea8f0af710549c0bdc94a3f32b35cd4)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:04.792195 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:04.851024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea8f0af710549c0bdc94a3f32b35cd4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.862209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea8f0af710549c0bdc94a3f32b35cd4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.863097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea8f0af710549c0bdc94a3f32b35cd4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.880749 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea8f0af710549c0bdc94a3f32b35cd4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.888980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-9e23d48a-e9b6-48ab-9947-853fbc02c8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea8f0af710549c0bdc94a3f32b35cd4'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:04.895251 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1321/2639] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:55:04 2022] DELETE /identity/v3/users/fea8f0af710549c0bdc94a3f32b35cd4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:05.289331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:05.290834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:05.305023 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ee7f-c802-44b2-9645-32eba083ed05 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:05.371263 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:05.372060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.372343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.372618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] PATH_INFO: `/v3/projects/6e67939f6ca440b29afa1813b90c29f3` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.373800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e67939f6ca440b29afa1813b90c29f3)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:05.400049 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:05.461255 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e67939f6ca440b29afa1813b90c29f3', 'request_id': 'req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:05.467279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e67939f6ca440b29afa1813b90c29f3', 'request_id': 'req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:05.477247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e67939f6ca440b29afa1813b90c29f3', 'request_id': 'req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:05.493517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] The token cache is being invalidate because project 6e67939f6ca440b29afa1813b90c29f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:05.493799 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:05.494404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-44bf3f8b-4136-45ba-9d61-d4bd52a0513c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:05.495877 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1319/2640] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:05 2022] DELETE /identity/v3/projects/6e67939f6ca440b29afa1813b90c29f3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:05.501109 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.501731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.502311 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.525166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:05.526313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:05.597044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1322/2641] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:05.604897 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.605186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.605461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.629274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:05.630437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:05.637745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1320/2642] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:05.642272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:05.654492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2eb91a-6eb9-4ff0-b128-4f8352841210 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:05.660483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:05.661326 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.661740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.662118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.663096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:55:05.663366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:05.693112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:05.708985 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1323/2643] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:05.713384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:05.723547 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f9770-ae2a-492b-8220-cf23a49f2c28 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:05.728310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:05.729412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.729836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.730119 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.730811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:05.761754 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:05.798421 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1321/2644] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:55:05.801538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:05.811773 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ccb00-a7fa-4c56-8597-fb1bfcdf6a66 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:05.880240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:05.880754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.881035 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.881310 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.881944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:05.908543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:05.933325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1324/2645] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:05 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:05.934532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:05.945002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76cfa-86f3-4cd8-8c50-62287de96b39 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:05.949244 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed68d8-9071-456d-af2f-73220af2c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:05.949826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed68d8-9071-456d-af2f-73220af2c46c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:05.950118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed68d8-9071-456d-af2f-73220af2c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:05.950396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed68d8-9071-456d-af2f-73220af2c46c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:05.951120 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed68d8-9071-456d-af2f-73220af2c46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:05.976662 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed68d8-9071-456d-af2f-73220af2c46c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:05.987907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1322/2646] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:05.992312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:06.002580 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf26ebe-edb2-4458-8c42-5b4a60af58f0 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:06.007530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:06.008341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.008908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.008908 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] PATH_INFO: `/v3/projects/fd0dcc5975fd432a91330f3c5bbb6c1e/users/0f25274beead4b83802bd8a28d13d6ff/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.029263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0dcc5975fd432a91330f3c5bbb6c1e, user_id=0f25274beead4b83802bd8a28d13d6ff, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:06.056515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:06.072148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1325/2647] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:05 2022] PUT /identity/v3/projects/fd0dcc5975fd432a91330f3c5bbb6c1e/users/0f25274beead4b83802bd8a28d13d6ff/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:06.085162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.085606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.086081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.125097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] MFA Rules not processed for user `0f25274beead4b83802bd8a28d13d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:06.126344 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:06.208605 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1323/2648] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:06 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:06.218470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:06.220356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:06.286330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fbdfc-ab7c-4973-96b3-ceda908f9fd5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:06.289839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8839a-7dd7-48fd-9b56-ad8d7ab877ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:06.290425 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8839a-7dd7-48fd-9b56-ad8d7ab877ce service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.290744 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8839a-7dd7-48fd-9b56-ad8d7ab877ce service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.291007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8839a-7dd7-48fd-9b56-ad8d7ab877ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.299494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8839a-7dd7-48fd-9b56-ad8d7ab877ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:06.324840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8839a-7dd7-48fd-9b56-ad8d7ab877ce service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:06.334307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1326/2649] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:06 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:06.354584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:06.423722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ae06-5ebc-4fe1-98fc-104756e4ee7c None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:06.428710 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:06.429522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.429806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.430083 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] PATH_INFO: `/v3/users/0f25274beead4b83802bd8a28d13d6ff` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.431315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f25274beead4b83802bd8a28d13d6ff)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:06.457232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:06.518690 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f25274beead4b83802bd8a28d13d6ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:06.526092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f25274beead4b83802bd8a28d13d6ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:06.534301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f25274beead4b83802bd8a28d13d6ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:06.534977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f25274beead4b83802bd8a28d13d6ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:06.535608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f25274beead4b83802bd8a28d13d6ff'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:06.554129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1324/2650] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:55:06 2022] DELETE /identity/v3/users/0f25274beead4b83802bd8a28d13d6ff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:06.558688 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.559181 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.559295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.585554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:06.586777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:06.663905 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1327/2651] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:06.674270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:06.675695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:06.739096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda8e3-3d9d-4bb8-8fb2-4b228ee704e7 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:06.743111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:06.743719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.744058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.744282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.753111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:06.754774 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:06.754944 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:06.784679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:06.794482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1325/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:06.835293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d1a43-75b2-4083-9578-a56ae238ac1a None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:06.840256 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:06.840849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:06.841212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:06.841484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:06.843304 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:06.854416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:06.880707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0088-a4d2-4da9-8b0b-3ffd01fb1d82 service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:06.890972 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1328/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:06 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:55:07.156413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.158389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:07.172414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04667fb4-4822-414c-bb29-f2bfb15d35ad service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.178225 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.179262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.179679 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.180055 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] PATH_INFO: `/v3/projects/fd0dcc5975fd432a91330f3c5bbb6c1e` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.181468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0dcc5975fd432a91330f3c5bbb6c1e)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:07.209183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.260919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0dcc5975fd432a91330f3c5bbb6c1e', 'request_id': 'req-b2d3fd66-8efa-4770-b753-67e273ed93e5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:07.265996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0dcc5975fd432a91330f3c5bbb6c1e', 'request_id': 'req-b2d3fd66-8efa-4770-b753-67e273ed93e5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:07.275907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0dcc5975fd432a91330f3c5bbb6c1e', 'request_id': 'req-b2d3fd66-8efa-4770-b753-67e273ed93e5'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:07.292767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] The token cache is being invalidate because project fd0dcc5975fd432a91330f3c5bbb6c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:07.293148 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:07.293826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-b2d3fd66-8efa-4770-b753-67e273ed93e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:07.295248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1326/2654] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:07 2022] DELETE /identity/v3/projects/fd0dcc5975fd432a91330f3c5bbb6c1e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:07.301024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.301412 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.301863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.325575 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:07.326865 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:07.396072 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1329/2655] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:07.408161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.408786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.408786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.434061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:07.435302 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:07.445367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1327/2656] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:07.449889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.459864 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff984-9db5-447d-aa0e-23dc6b0c3430 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.464490 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.465114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.465399 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.465703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.466397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:55:07.466730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:07.493042 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.506849 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1330/2657] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:07.511372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.520299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5ed16-387b-47e7-8163-791eaad3d2dd None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.524512 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.525102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.525564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.525991 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.526747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:07.553035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.596431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1328/2658] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:07 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:07.600413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.612080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04bf0-7cd7-4e34-90f8-3556a8beb4c5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.695495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.696132 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.696413 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.696711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.697349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:07.726589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.747626 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1331/2659] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:07 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:07.751948 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.761892 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333edf4-a535-4ee7-bad3-f8f03e24c0c5 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.765907 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be34f4-8d15-44cd-9704-299cdea8fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.766491 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be34f4-8d15-44cd-9704-299cdea8fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.766806 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be34f4-8d15-44cd-9704-299cdea8fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.767321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be34f4-8d15-44cd-9704-299cdea8fa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.768025 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be34f4-8d15-44cd-9704-299cdea8fa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:07.795609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be34f4-8d15-44cd-9704-299cdea8fa53 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.811145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1329/2660] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:07.812367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:07.823224 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e3b4c-6afc-4b48-ae63-90d3b1be5431 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:07.828728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:07.829649 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.830395 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.830835 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] PATH_INFO: `/v3/projects/4cadfcaf8f4443f18adc6e0599d23fe8/users/b7e57794f8374e5c93b827c9fd0b298a/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.851933 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cadfcaf8f4443f18adc6e0599d23fe8, user_id=b7e57794f8374e5c93b827c9fd0b298a, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:07.880076 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:07.897590 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1332/2661] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:07 2022] PUT /identity/v3/projects/4cadfcaf8f4443f18adc6e0599d23fe8/users/b7e57794f8374e5c93b827c9fd0b298a/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:07.911216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:07.911677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:07.911970 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:07.951734 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] MFA Rules not processed for user `b7e57794f8374e5c93b827c9fd0b298a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:07.952889 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:08.031153 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1330/2662] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:07 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:08.036266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.109204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1aec-0cd1-4b80-840e-6aa202b4ff06 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.115342 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.115942 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.116223 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.116495 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.117687 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.149389 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.178403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1333/2663] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:08 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:08.182624 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.197136 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6444e-6d5e-49e9-bdb1-aa89e54836f0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.264524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.265132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.265416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.265691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.266351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.292057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.318677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1331/2664] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:08 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:08.320673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.335373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697f1e9-50d2-4cb9-9099-57b4080acc9d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.340505 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768d17-3fe1-4d93-be77-82309565f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.341114 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768d17-3fe1-4d93-be77-82309565f9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.341401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768d17-3fe1-4d93-be77-82309565f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.341685 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768d17-3fe1-4d93-be77-82309565f9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.342386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768d17-3fe1-4d93-be77-82309565f9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.367900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768d17-3fe1-4d93-be77-82309565f9e0 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.379848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1334/2665] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:55:08.384269 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.394714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5774470-f3cf-4464-8ec6-ab637840e152 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.399520 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.400349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.400637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.400917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] PATH_INFO: `/v3/projects/cf58ffc177d542678a24da519a77d1e3/users/8dfee441c4614c69adcd2a1d69787f68/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.421150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf58ffc177d542678a24da519a77d1e3, user_id=8dfee441c4614c69adcd2a1d69787f68, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.447592 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.462044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1332/2666] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:08 2022] PUT /identity/v3/projects/cf58ffc177d542678a24da519a77d1e3/users/8dfee441c4614c69adcd2a1d69787f68/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:55:08.472660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.473000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.473282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.510064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] MFA Rules not processed for user `8dfee441c4614c69adcd2a1d69787f68`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:08.511367 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:08.584770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1335/2667] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:08 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:08.589423 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.662767 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2c4-fe74-4cc9-b0de-780cbaf14882 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.667700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.668178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.668463 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.668727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.669348 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.695975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.726472 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1333/2668] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:08 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:08.730651 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.742094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773e7b-57b5-404a-9ac4-3593dc12d2b1 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.810852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.811347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.811619 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.811899 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.812554 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.837911 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.859540 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1336/2669] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:08 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:08.863919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.873864 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eb6b2-1304-4bb1-8e3a-5a0040c46cb8 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.878275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.878906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.879195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.879505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.880176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.905574 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:08.920654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1334/2670] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:08.921904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:08.931913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083099-6c26-4c25-b6d6-985b73bf9274 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:08.936756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:08.938066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:08.938481 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:08.938801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] PATH_INFO: `/v3/projects/5842b099de6b4aa5ab6329f419ccb061/users/122a109fc43c4b5bacf507e668cf6625/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:08.959307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5842b099de6b4aa5ab6329f419ccb061, user_id=122a109fc43c4b5bacf507e668cf6625, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:08.986023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.001882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1337/2671] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:08 2022] PUT /identity/v3/projects/5842b099de6b4aa5ab6329f419ccb061/users/122a109fc43c4b5bacf507e668cf6625/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:09.006953 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.020747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b6d9-400b-4b36-9066-e2c98f109a41 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.088590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.089118 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.089402 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.089677 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.090370 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:09.115678 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.126032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1335/2672] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:55:09.130593 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.141105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a02d4e-1668-4d61-829c-f7393e46526d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.147350 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.148226 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.148507 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.148756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] PATH_INFO: `/v3/projects/5842b099de6b4aa5ab6329f419ccb061/users/122a109fc43c4b5bacf507e668cf6625/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.151012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5842b099de6b4aa5ab6329f419ccb061, user_id=122a109fc43c4b5bacf507e668cf6625, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:09.176975 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.188239 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1338/2673] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:09 2022] PUT /identity/v3/projects/5842b099de6b4aa5ab6329f419ccb061/users/122a109fc43c4b5bacf507e668cf6625/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:09.193058 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.211803 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f39f-5e52-43d6-bb1f-44c528500a89 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.278692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbb79a-0685-415e-b512-7237300a4aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.279301 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb79a-0685-415e-b512-7237300a4aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.279587 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb79a-0685-415e-b512-7237300a4aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.279859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb79a-0685-415e-b512-7237300a4aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.280575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbb79a-0685-415e-b512-7237300a4aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:09.305884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbb79a-0685-415e-b512-7237300a4aa3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.318790 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1336/2674] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:09.324007 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.339547 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897699a-0034-4741-82cb-e6618fe8d652 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.346857 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.347681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.347963 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.348237 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] PATH_INFO: `/v3/projects/5842b099de6b4aa5ab6329f419ccb061/users/122a109fc43c4b5bacf507e668cf6625/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.350299 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5842b099de6b4aa5ab6329f419ccb061, user_id=122a109fc43c4b5bacf507e668cf6625, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:09.376283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.394046 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1339/2675] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:09 2022] PUT /identity/v3/projects/5842b099de6b4aa5ab6329f419ccb061/users/122a109fc43c4b5bacf507e668cf6625/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:09.409998 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.410289 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.410580 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.453992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] MFA Rules not processed for user `122a109fc43c4b5bacf507e668cf6625`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:09.455270 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:09.547688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1337/2676] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:09 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:09.559325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:09.561369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:09.626213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ada2b8-b1e1-42f1-a45c-81aa22f42180 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:09.629889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:09.630464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:09.630783 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:09.631058 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:09.696523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:09.721945 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:09.731418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1340/2677] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:09 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:11.427725 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:11.429283 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:11.442128 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ede69-3b6c-4f05-9ca9-f7774f1678d4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:11.446925 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5484a-d8a9-4031-9854-e9d7c92f5edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:11.447511 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5484a-d8a9-4031-9854-e9d7c92f5edc service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:11.447826 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5484a-d8a9-4031-9854-e9d7c92f5edc service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:11.448100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5484a-d8a9-4031-9854-e9d7c92f5edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:11.513406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5484a-d8a9-4031-9854-e9d7c92f5edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:11.538865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5484a-d8a9-4031-9854-e9d7c92f5edc service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:11.548322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1338/2678] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:11 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:12.288710 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:12.298002 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb4f36-d0d9-4d09-b500-d33f1200e507 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:12.301622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:12.302209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:12.302528 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:12.302837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:12.311993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:12.337066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:12.346682 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1341/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:12 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:15.749714 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:15.750211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:15.750311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:15.773056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:15.774197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:15.841046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1339/2680] 10.222.0.18 () {58 vars in 967 bytes} [Mon Feb 28 18:55:15 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:15.854599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:15.856104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:15.936324 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5918a1-4013-45eb-b959-4e2dc12d2911 service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:15.941356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9ca7e-7351-414d-acd9-016248488b58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:15.941946 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ca7e-7351-414d-acd9-016248488b58 service swift] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:15.942279 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ca7e-7351-414d-acd9-016248488b58 service swift] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:15.942598 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9ca7e-7351-414d-acd9-016248488b58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:15.950977 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9ca7e-7351-414d-acd9-016248488b58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:15.976171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9ca7e-7351-414d-acd9-016248488b58 service swift] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:15.984936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1342/2681] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:55:16.786522 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:16.860588 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c422d-dc3a-4052-be8d-b27cb75678aa None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:16.866046 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:16.866878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:16.867165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:16.867471 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] PATH_INFO: `/v3/users/b7e57794f8374e5c93b827c9fd0b298a` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:16.868650 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e57794f8374e5c93b827c9fd0b298a)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:16.894242 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:16.952514 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e57794f8374e5c93b827c9fd0b298a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:16.960369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e57794f8374e5c93b827c9fd0b298a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:16.968787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e57794f8374e5c93b827c9fd0b298a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:16.969352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e57794f8374e5c93b827c9fd0b298a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:16.970005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e57794f8374e5c93b827c9fd0b298a'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:16.986999 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1340/2682] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:55:16 2022] DELETE /identity/v3/users/b7e57794f8374e5c93b827c9fd0b298a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:16.992189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:16.992931 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:16.993126 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.027025 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:17.028465 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:17.104496 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1343/2683] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:17.117818 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:17.119916 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:17.196989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7014099-115d-496c-81f7-9a39234b7502 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:17.200833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:17.201422 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.201716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.202001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.211571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:17.236671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:17.246519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1341/2684] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:17.621840 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:17.623317 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:17.634537 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa9a37-d5b5-4135-80e7-9700a8d605f8 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:17.638956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:17.639755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.640013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.640673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] PATH_INFO: `/v3/projects/4cadfcaf8f4443f18adc6e0599d23fe8` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.641760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cadfcaf8f4443f18adc6e0599d23fe8)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:17.667829 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:17.729016 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cadfcaf8f4443f18adc6e0599d23fe8', 'request_id': 'req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.734891 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cadfcaf8f4443f18adc6e0599d23fe8', 'request_id': 'req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.744546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cadfcaf8f4443f18adc6e0599d23fe8', 'request_id': 'req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.760961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] The token cache is being invalidate because project 4cadfcaf8f4443f18adc6e0599d23fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:17.761268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.761854 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.763267 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1344/2685] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:17 2022] DELETE /identity/v3/projects/4cadfcaf8f4443f18adc6e0599d23fe8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:55:17.767329 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:17.776858 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade807-0ceb-49a2-b797-56f66a0afb01 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:17.859862 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:17.860728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:17.861100 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:17.861458 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] PATH_INFO: `/v3/users/8dfee441c4614c69adcd2a1d69787f68` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:17.862751 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfee441c4614c69adcd2a1d69787f68)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:17.887819 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:17.944968 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfee441c4614c69adcd2a1d69787f68'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.952910 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfee441c4614c69adcd2a1d69787f68'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.961039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfee441c4614c69adcd2a1d69787f68'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.961713 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfee441c4614c69adcd2a1d69787f68'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.962306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfee441c4614c69adcd2a1d69787f68'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:17.980065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1342/2686] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:55:17 2022] DELETE /identity/v3/users/8dfee441c4614c69adcd2a1d69787f68 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:18.351349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:18.352846 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:18.365742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1348e1-7efb-4a4b-9c4e-76c1f0a11fe6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:18.432283 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:18.433406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:18.433764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:18.434108 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] PATH_INFO: `/v3/projects/cf58ffc177d542678a24da519a77d1e3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:18.436127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf58ffc177d542678a24da519a77d1e3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:18.463010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:18.517487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf58ffc177d542678a24da519a77d1e3', 'request_id': 'req-fe88f600-9de9-420a-bf60-7888b25dabab'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.523691 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf58ffc177d542678a24da519a77d1e3', 'request_id': 'req-fe88f600-9de9-420a-bf60-7888b25dabab'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.534008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf58ffc177d542678a24da519a77d1e3', 'request_id': 'req-fe88f600-9de9-420a-bf60-7888b25dabab'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.551704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] The token cache is being invalidate because project cf58ffc177d542678a24da519a77d1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:18.552105 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.553009 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.555294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1345/2687] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:18 2022] DELETE /identity/v3/projects/cf58ffc177d542678a24da519a77d1e3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:18.561437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:18.562900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:18.580946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e4be1-abfd-4479-a799-32d2e47728e3 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:18.646325 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:18.647499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:18.647830 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:18.648211 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] PATH_INFO: `/v3/users/122a109fc43c4b5bacf507e668cf6625` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:18.650071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122a109fc43c4b5bacf507e668cf6625)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:18.684277 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:18.740442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122a109fc43c4b5bacf507e668cf6625'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.748275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122a109fc43c4b5bacf507e668cf6625'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.757752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122a109fc43c4b5bacf507e668cf6625'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.758338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122a109fc43c4b5bacf507e668cf6625'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.758936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ce63e4d8-7502-4b5f-8b59-e1dabc125137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122a109fc43c4b5bacf507e668cf6625'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:18.776839 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1343/2688] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:55:18 2022] DELETE /identity/v3/users/122a109fc43c4b5bacf507e668cf6625 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:19.138794 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.141286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:19.157562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88f600-9de9-420a-bf60-7888b25dabab admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.223383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.224188 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.224469 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.224738 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] PATH_INFO: `/v3/projects/5842b099de6b4aa5ab6329f419ccb061` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.225822 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5842b099de6b4aa5ab6329f419ccb061)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:19.251483 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.311117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5842b099de6b4aa5ab6329f419ccb061', 'request_id': 'req-b8daf50f-f4fa-45fc-9265-ad0804be49bc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:19.316556 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5842b099de6b4aa5ab6329f419ccb061', 'request_id': 'req-b8daf50f-f4fa-45fc-9265-ad0804be49bc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:19.324872 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5842b099de6b4aa5ab6329f419ccb061', 'request_id': 'req-b8daf50f-f4fa-45fc-9265-ad0804be49bc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:19.341384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] The token cache is being invalidate because project 5842b099de6b4aa5ab6329f419ccb061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:55:19.341668 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:19.342268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-b8daf50f-f4fa-45fc-9265-ad0804be49bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:55:19.343714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1346/2689] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:55:19 2022] DELETE /identity/v3/projects/5842b099de6b4aa5ab6329f419ccb061 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:19.348748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.349226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.349346 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.371538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:19.372676 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:19.438455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1344/2690] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:19.447443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.447940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.448038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.471456 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:19.474421 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:19.484740 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1347/2691] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:19.490436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.506537 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938a03e-2c4a-41e2-a47d-e95c6b6fbc51 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.515571 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.516498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.516975 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.517442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.518609 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:55:19.519264 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:19.544614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.560855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1345/2692] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:55:19.567024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.576038 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e225bf-13fa-4742-9e02-1019998ec681 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.581548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.582134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.582416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.582722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.583356 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:19.609498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.644186 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1348/2693] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:55:19 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:19.648788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.659247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264053-b7c1-4743-ab3a-7e67e05cdee0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.729154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.729800 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.730125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.730513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.731276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:19.757608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.779035 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1346/2694] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:55:19 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:55:19.783379 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.794147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deda2f7-8c3f-4234-8ea1-1be8af294bc8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.798492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fb484-c1a2-43df-9ea6-936fe8c4ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.799098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb484-c1a2-43df-9ea6-936fe8c4ca00 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.799384 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb484-c1a2-43df-9ea6-936fe8c4ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.799660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fb484-c1a2-43df-9ea6-936fe8c4ca00 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.800806 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb484-c1a2-43df-9ea6-936fe8c4ca00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:19.826735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fb484-c1a2-43df-9ea6-936fe8c4ca00 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.837882 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1349/2695] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:55:19.842937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:19.854584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd277e-6a70-43bc-a3d0-b977c4d3224f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:19.859309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:19.860112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.860394 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.860671 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] PATH_INFO: `/v3/projects/478112749e0846bea0d05d3073d383cd/users/6908aebf39fe480591afc319cf28d549/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.883104 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=478112749e0846bea0d05d3073d383cd, user_id=6908aebf39fe480591afc319cf28d549, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:19.919695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:19.935262 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1347/2696] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:55:19 2022] PUT /identity/v3/projects/478112749e0846bea0d05d3073d383cd/users/6908aebf39fe480591afc319cf28d549/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:55:19.941539 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e134-c6c5-4383-927e-d7724d730461 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:19.941836 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e134-c6c5-4383-927e-d7724d730461 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:19.942117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e134-c6c5-4383-927e-d7724d730461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:19.965135 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e2c7e134-c6c5-4383-927e-d7724d730461 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:19.966278 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e2c7e134-c6c5-4383-927e-d7724d730461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:20.031656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1350/2697] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:55:20.044197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:20.047111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:20.119166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2c1fb-c8cf-407c-87b3-63c6eb58c90d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:20.124039 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:20.124626 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:20.124914 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:20.125193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:20.136342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:20.161462 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:20.171707 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1348/2698] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:21.064851 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaf4b-6b0f-4bef-93e3-90ec10ee612f None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:21.065316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaf4b-6b0f-4bef-93e3-90ec10ee612f None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:21.066166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eaf4b-6b0f-4bef-93e3-90ec10ee612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:21.103818 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-550eaf4b-6b0f-4bef-93e3-90ec10ee612f None None] MFA Rules not processed for user `6908aebf39fe480591afc319cf28d549`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:21.104978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-550eaf4b-6b0f-4bef-93e3-90ec10ee612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:21.178174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1351/2699] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:21 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:55:21.187937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:55:21.189353 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:21.255630 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03727e-6ce9-4356-ae09-22661cae4e08 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:55:21.259051 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36975bd8-b35c-42cb-a93f-fca6e15c9372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:55:21.259635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975bd8-b35c-42cb-a93f-fca6e15c9372 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:21.259918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975bd8-b35c-42cb-a93f-fca6e15c9372 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:21.260193 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975bd8-b35c-42cb-a93f-fca6e15c9372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:21.268442 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36975bd8-b35c-42cb-a93f-fca6e15c9372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:55:21.293600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36975bd8-b35c-42cb-a93f-fca6e15c9372 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:55:21.304722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1349/2700] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:55:21 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:55:22.833313 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac43045-e043-42b3-8589-85ffaf576edd None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:55:22.833881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac43045-e043-42b3-8589-85ffaf576edd None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:55:22.833881 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac43045-e043-42b3-8589-85ffaf576edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:55:22.861091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-dac43045-e043-42b3-8589-85ffaf576edd None None] MFA Rules not processed for user `6908aebf39fe480591afc319cf28d549`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:55:22.862214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dac43045-e043-42b3-8589-85ffaf576edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:55:22.869824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1352/2701] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:55:22 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:48.916030 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:48.916845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:48.916845 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:48.949066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] MFA Rules not processed for user `549b7a82cab9488a815c3e68a95b10db`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:48.950212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:49.019540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1350/2702] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:56:48 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:52.856470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:52.857062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:52.857062 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:52.880010 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] MFA Rules not processed for user `6908aebf39fe480591afc319cf28d549`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:56:52.881177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:52.888233 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1353/2703] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:56:52 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:56:57.589097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:57.590880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:57.603033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee00b50-c2ab-433d-9723-7ea9fccadf3d None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:57.606881 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:57.607330 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:57.607616 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:57.607900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:57.609789 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:57.688440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:56:57.713833 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:57.725159 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1351/2704] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:56:58.982943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:56:58.993179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9698-002a-418b-9a79-0fa361dd3ab5 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:56:58.997034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:56:58.997617 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:56:58.997902 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:56:58.998177 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:56:59.000397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:56:59.013824 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:56:59.039012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:56:59.049915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1354/2705] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:56:58 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:13.896024 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:13.905105 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59caaa-a163-4153-a474-ab2b7ebbec54 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:13.908552 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:13.909122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:13.909407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:13.909669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:13.911401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:13.922880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:13.953534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:13.969186 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1352/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:13.985017 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:13.996029 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729742c-c744-4d32-970f-3164fdc24d35 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:14.000168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:14.000754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:14.001044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:14.001306 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:14.002986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:14.014900 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:14.041584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:14.053125 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1355/2707] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:24.009306 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:24.022417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497fe67-8103-437f-940e-8127df6da448 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:24.031831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:24.034073 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:24.034815 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:24.035139 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:24.037822 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:24.053810 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:24.080258 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:24.103924 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1353/2708] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:24 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:27.287774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:27.289602 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:27.301238 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4ce2-f687-4888-879c-c161068dbdff service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:27.305889 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:27.306711 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:27.306995 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:27.307276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] PATH_INFO: `/v3/users/fa4639aff93a476ea70ba053c8bad1cb` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:27.308344 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4639aff93a476ea70ba053c8bad1cb)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:27.334230 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:27.393096 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4639aff93a476ea70ba053c8bad1cb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.402741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4639aff93a476ea70ba053c8bad1cb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.403390 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4639aff93a476ea70ba053c8bad1cb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.422514 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4639aff93a476ea70ba053c8bad1cb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.434295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4639aff93a476ea70ba053c8bad1cb'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.444511 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1356/2709] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:57:27 2022] DELETE /identity/v3/users/fa4639aff93a476ea70ba053c8bad1cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:27.690977 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:27.702716 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb1a8d-9233-4171-a214-5d39a555b3e8 service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:27.771439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:27.772908 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:27.773261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:27.773771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] PATH_INFO: `/v3/projects/df6310ee4c214b53bfc3fa13d6f15b83` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:27.778056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6310ee4c214b53bfc3fa13d6f15b83)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:27.804482 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:27.887235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6310ee4c214b53bfc3fa13d6f15b83', 'request_id': 'req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.893796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6310ee4c214b53bfc3fa13d6f15b83', 'request_id': 'req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.904327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6310ee4c214b53bfc3fa13d6f15b83', 'request_id': 'req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.924645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] The token cache is being invalidate because project df6310ee4c214b53bfc3fa13d6f15b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:57:27.925002 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.925840 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:27.930738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1354/2710] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:57:27 2022] DELETE /identity/v3/projects/df6310ee4c214b53bfc3fa13d6f15b83 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:27.932196 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:27.933625 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:27.947463 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6bc1-360e-4a61-848d-be0752883a51 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:28.023817 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:28.024523 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:28.024805 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:28.025081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] PATH_INFO: `/v3/users/b9ebef92ee034ac788278db5e75054d0` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:28.026189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ebef92ee034ac788278db5e75054d0)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:28.054294 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:28.115843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ebef92ee034ac788278db5e75054d0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.123968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ebef92ee034ac788278db5e75054d0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.124581 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ebef92ee034ac788278db5e75054d0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.136766 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ebef92ee034ac788278db5e75054d0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.144397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ebef92ee034ac788278db5e75054d0'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.150534 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1357/2711] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:57:27 2022] DELETE /identity/v3/users/b9ebef92ee034ac788278db5e75054d0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:57:28.380884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:28.382687 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:28.396008 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0330bf8-7fa5-410c-a08f-8bd10dce6c13 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:28.461573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:28.462379 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:28.462697 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:28.462973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] PATH_INFO: `/v3/projects/db398b9d5dbe4cda9280752fbebbddaf` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:28.464149 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db398b9d5dbe4cda9280752fbebbddaf)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:28.489719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:28.545429 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db398b9d5dbe4cda9280752fbebbddaf', 'request_id': 'req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.551032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db398b9d5dbe4cda9280752fbebbddaf', 'request_id': 'req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.559722 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db398b9d5dbe4cda9280752fbebbddaf', 'request_id': 'req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.576579 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] The token cache is being invalidate because project db398b9d5dbe4cda9280752fbebbddaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:57:28.576861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.577477 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:28.578963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1355/2712] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:57:28 2022] DELETE /identity/v3/projects/db398b9d5dbe4cda9280752fbebbddaf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:32.787546 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:32.788948 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:32.851066 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67087-7242-4ae5-8931-6e23c032c00f admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:32.909373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:32.909968 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:32.910253 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:32.910529 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:32.912893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:32.984438 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:33.009544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:33.019164 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1358/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:39.818074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:39.819507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:39.833409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbff6ec-f71a-4a41-a6ad-5688d8e1d9a1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:39.840278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:39.842620 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:39.843092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:39.843567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] PATH_INFO: `/v3/users/6b707673c1614cb59683ffa0810cc6a0` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:39.864551 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b707673c1614cb59683ffa0810cc6a0)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:39.890720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:39.948071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b707673c1614cb59683ffa0810cc6a0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:39.955886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b707673c1614cb59683ffa0810cc6a0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:39.965074 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b707673c1614cb59683ffa0810cc6a0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:39.965682 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b707673c1614cb59683ffa0810cc6a0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:39.966252 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-bf63b706-651b-4483-8e63-17a4186b812d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b707673c1614cb59683ffa0810cc6a0'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:39.984183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1356/2714] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:57:39 2022] DELETE /identity/v3/users/6b707673c1614cb59683ffa0810cc6a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:40.256011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:40.278401 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9d02-341d-40c2-8f84-d3a5eb81dd49 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:40.352548 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:40.353676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:40.354122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:40.354486 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] PATH_INFO: `/v3/projects/6c9c9337657d43f59f92137cbfb4bdcb` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:40.369550 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9c9337657d43f59f92137cbfb4bdcb)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:40.395097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:40.463134 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9c9337657d43f59f92137cbfb4bdcb', 'request_id': 'req-2a1980fa-8ea3-4273-a710-e7085fb97cf7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:40.469021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9c9337657d43f59f92137cbfb4bdcb', 'request_id': 'req-2a1980fa-8ea3-4273-a710-e7085fb97cf7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:40.479986 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9c9337657d43f59f92137cbfb4bdcb', 'request_id': 'req-2a1980fa-8ea3-4273-a710-e7085fb97cf7'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:40.496989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] The token cache is being invalidate because project 6c9c9337657d43f59f92137cbfb4bdcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:57:40.497276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:40.497950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2a1980fa-8ea3-4273-a710-e7085fb97cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:40.499515 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1359/2715] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:57:40 2022] DELETE /identity/v3/projects/6c9c9337657d43f59f92137cbfb4bdcb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:40.504771 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:40.505068 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:40.505362 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:40.528092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:40.529282 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:40.604729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1357/2716] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:40.613089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:40.613459 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:40.613813 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:40.640454 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:40.641610 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:40.649909 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1360/2717] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:57:40.654349 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:40.665014 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e6944-a532-4945-94f3-9c5269fc5714 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:40.673168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:40.673764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:40.674106 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:40.674384 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] PATH_INFO: `/v3/domains` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:40.675232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66297) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:57:40.675865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:40.704342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:40.719894 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1358/2718] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:57:40.726988 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:40.736841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767a1ca-d42b-42b4-be11-e86de8065fe3 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:40.742403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:40.743117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:40.743557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:40.743989 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:40.744621 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:40.771397 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:40.890578 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1361/2719] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:57:40 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:57:40.895070 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:40.905226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960a78-a62e-4f59-99a4-3e972b18ea63 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:40.974600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:40.975123 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:40.975437 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:40.975712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:40.976339 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:41.002067 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:41.028396 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1359/2720] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:57:40 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:57:41.032721 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:41.043340 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7134a-077c-47e7-9911-f7dc2c874027 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:41.048080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709921c-c2a2-4b72-94e6-1c5ee2ec220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:41.048663 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709921c-c2a2-4b72-94e6-1c5ee2ec220c admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:41.048943 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709921c-c2a2-4b72-94e6-1c5ee2ec220c admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:41.049217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709921c-c2a2-4b72-94e6-1c5ee2ec220c admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:41.049907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709921c-c2a2-4b72-94e6-1c5ee2ec220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:41.075758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709921c-c2a2-4b72-94e6-1c5ee2ec220c admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:41.086377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1362/2721] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:57:41.091040 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:41.101620 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc415d75-d9cf-4d14-8004-bddfbc2241fe admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:41.107161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:41.107976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:41.108314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:41.108583 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] PATH_INFO: `/v3/projects/5a21e48538ae46fb873089bdd548e64b/users/0f71a238c2ad435f9fd559cfe18d172d/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:41.133275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a21e48538ae46fb873089bdd548e64b, user_id=0f71a238c2ad435f9fd559cfe18d172d, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:41.160203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:41.178012 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1360/2722] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:57:41 2022] PUT /identity/v3/projects/5a21e48538ae46fb873089bdd548e64b/users/0f71a238c2ad435f9fd559cfe18d172d/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:41.188572 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12906f7a-d6fa-45df-86bc-42b355057e52 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:41.188860 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12906f7a-d6fa-45df-86bc-42b355057e52 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:41.189122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12906f7a-d6fa-45df-86bc-42b355057e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:41.226779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-12906f7a-d6fa-45df-86bc-42b355057e52 None None] MFA Rules not processed for user `0f71a238c2ad435f9fd559cfe18d172d`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:41.227980 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-12906f7a-d6fa-45df-86bc-42b355057e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:41.300910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1363/2723] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:41.311075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:41.312855 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:41.377659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc09c66-31c1-45d9-b01f-4550ca5e5afe admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:41.382003 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:41.382664 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:41.382929 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:41.383207 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:41.394986 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:41.425179 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:41.435544 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1361/2724] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:41 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:57:59.255393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:59.255878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:59.256013 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:59.278730 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] MFA Rules not processed for user `8f45fc4f68f64c9a834fe0ccae08350a`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:59.279894 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:59.346797 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1364/2725] 10.222.0.18 () {58 vars in 967 bytes} [Mon Feb 28 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:59.408367 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:59.410611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:59.496461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3820d-9e89-4834-bb07-dee606b52c31 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:59.502786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3fdca-8bfe-41fd-8019-38ff1babce28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b74d6c68e049ad8744b504680d1af0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:59.503899 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3fdca-8bfe-41fd-8019-38ff1babce28 service swift] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:59.504337 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3fdca-8bfe-41fd-8019-38ff1babce28 service swift] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:59.504719 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3fdca-8bfe-41fd-8019-38ff1babce28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:59.516816 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3fdca-8bfe-41fd-8019-38ff1babce28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:59.544700 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3fdca-8bfe-41fd-8019-38ff1babce28 service swift] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:59.553240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1362/2726] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Feb 28 18:57:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 18:57:59.591392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:59.663485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b0bef-464a-4398-8fd7-6b94a98a620d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:59.668169 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:59.668983 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:59.669272 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:59.669558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] PATH_INFO: `/v3/users/0f71a238c2ad435f9fd559cfe18d172d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:59.670755 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f71a238c2ad435f9fd559cfe18d172d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:57:59.697482 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:57:59.750741 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f71a238c2ad435f9fd559cfe18d172d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:59.758707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f71a238c2ad435f9fd559cfe18d172d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:59.759973 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f71a238c2ad435f9fd559cfe18d172d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:59.772518 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f71a238c2ad435f9fd559cfe18d172d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:59.780308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f71a238c2ad435f9fd559cfe18d172d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:57:59.786585 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1365/2727] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:57:59 2022] DELETE /identity/v3/users/0f71a238c2ad435f9fd559cfe18d172d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:57:59.791224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:59.791534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:59.791752 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:57:59.815287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:57:59.816505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:59.887747 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1363/2728] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:57:59.898445 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:57:59.903330 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:57:59.987752 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3290a97-c1bc-4c35-8ca2-4427716650a6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:57:59.991999 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9893d-44fe-4eb8-9f17-98cd65c436a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:57:59.992713 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9893d-44fe-4eb8-9f17-98cd65c436a5 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:57:59.993030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9893d-44fe-4eb8-9f17-98cd65c436a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:57:59.993312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9893d-44fe-4eb8-9f17-98cd65c436a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.008174 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9893d-44fe-4eb8-9f17-98cd65c436a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:00.033664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9893d-44fe-4eb8-9f17-98cd65c436a5 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:00.046309 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1366/2729] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:57:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:58:00.424748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:00.426980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:00.439976 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e19ae6-f411-4809-afdd-d008df8699e0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:00.444524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:00.445343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:00.445611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:00.445887 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] PATH_INFO: `/v3/projects/5a21e48538ae46fb873089bdd548e64b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.447195 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a21e48538ae46fb873089bdd548e64b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:00.473178 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:00.530168 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a21e48538ae46fb873089bdd548e64b', 'request_id': 'req-ff913857-4d3d-4e23-b203-ade090e4137b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:00.535590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a21e48538ae46fb873089bdd548e64b', 'request_id': 'req-ff913857-4d3d-4e23-b203-ade090e4137b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:00.544655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a21e48538ae46fb873089bdd548e64b', 'request_id': 'req-ff913857-4d3d-4e23-b203-ade090e4137b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:00.562133 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] The token cache is being invalidate because project 5a21e48538ae46fb873089bdd548e64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:00.562457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:00.563109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-ff913857-4d3d-4e23-b203-ade090e4137b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:00.566647 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1364/2730] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:00 2022] DELETE /identity/v3/projects/5a21e48538ae46fb873089bdd548e64b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:00.569916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:00.570764 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:00.571201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.595060 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:00.596227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:00.662428 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1367/2731] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:00.670456 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:00.671158 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:00.671439 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.695191 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:00.696338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:00.705279 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1365/2732] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:00.709657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:00.724874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cedb7-f44f-400b-ac51-3159a4909e7d None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:00.729756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:00.730532 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:00.730917 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:00.731284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.732018 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:58:00.732393 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:00.758107 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:00.771644 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1368/2733] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:58:00.778381 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:00.788066 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb45d7-6e85-4850-bc6b-f32ab5ad0569 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:00.793305 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:00.794060 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:00.794483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:00.795146 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.795980 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:00.822635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:00.852407 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1366/2734] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:00 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:00.856750 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:00.866513 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651b91-3819-4ce2-8d53-655d7ea36359 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:00.930443 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:00.931254 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:00.931545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:00.931868 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:00.932468 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:00.958371 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:00.980215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1369/2735] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:00 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:00.984479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:00.995905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0362b-3fc6-4d4f-8847-3d0bd36361fb admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.000917 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09938318-0a40-4b56-bead-989164ebefdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.001590 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938318-0a40-4b56-bead-989164ebefdc admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.001946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938318-0a40-4b56-bead-989164ebefdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.002294 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938318-0a40-4b56-bead-989164ebefdc admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.003137 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09938318-0a40-4b56-bead-989164ebefdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.028911 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09938318-0a40-4b56-bead-989164ebefdc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.039796 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1367/2736] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:58:01.044312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.054131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a57c9-4e26-47c3-8495-19c2fd0be2e4 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.058142 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.059032 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.059319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.059603 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] PATH_INFO: `/v3/projects/b3a11374c7b147dcbfe42b7a65995974/users/bb5dd69a6cda49869544edd8eb8b04c2/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.080450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a11374c7b147dcbfe42b7a65995974, user_id=bb5dd69a6cda49869544edd8eb8b04c2, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.107284 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.122314 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1370/2737] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:01 2022] PUT /identity/v3/projects/b3a11374c7b147dcbfe42b7a65995974/users/bb5dd69a6cda49869544edd8eb8b04c2/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:58:01.132273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.132564 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.132847 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.178224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] MFA Rules not processed for user `bb5dd69a6cda49869544edd8eb8b04c2`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:01.178224 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:01.262591 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1368/2738] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:01.267323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.340102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275abaa-cb0c-4bd3-8715-6cf299440465 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.344833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.345553 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.345833 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.346115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.346798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.372777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.408981 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1371/2739] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:01 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:58:01.410431 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.421625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c82580-68ae-4f6a-a989-345ec35244c9 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.488108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.488791 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.488997 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.489275 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.489926 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.515960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.541447 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1369/2740] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:01 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:58:01.543183 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.553081 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50f2f-f275-44eb-803f-95b0b5239d3b admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.557252 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.557844 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.558130 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.558409 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.559137 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.585019 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.597241 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1372/2741] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:01.601540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.612000 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004816fc-d98f-42a6-8ba1-bee9fa21d924 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.617766 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.618792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.619549 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.620197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] PATH_INFO: `/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276/users/9316eeb677ac4115abb80d9b14229cfc/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.643371 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdcdc12bd8147dbb5c6e993727c3276, user_id=9316eeb677ac4115abb80d9b14229cfc, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.673994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.694606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1370/2742] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:01 2022] PUT /identity/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276/users/9316eeb677ac4115abb80d9b14229cfc/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:58:01.696023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.707098 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0b123-bb41-4894-9383-d9a0e1734513 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.784447 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.785052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.785339 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.785620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.786316 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.811704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.827030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1373/2743] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:58:01.828182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.840920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344aa28e-f81e-4288-8577-4ae1c7474a05 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.847300 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.848166 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.848455 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.848733 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] PATH_INFO: `/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276/users/9316eeb677ac4115abb80d9b14229cfc/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.850962 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdcdc12bd8147dbb5c6e993727c3276, user_id=9316eeb677ac4115abb80d9b14229cfc, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:01.879082 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:01.890541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1371/2744] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:01 2022] PUT /identity/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276/users/9316eeb677ac4115abb80d9b14229cfc/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:58:01.894667 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:01.912938 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729165f2-68af-40ba-aa04-2cbf215199c2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:01.975808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c6539-642c-4138-9af5-c995c7ab74b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:01.976411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c6539-642c-4138-9af5-c995c7ab74b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:01.976698 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c6539-642c-4138-9af5-c995c7ab74b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:01.976978 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c6539-642c-4138-9af5-c995c7ab74b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:01.977673 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c6539-642c-4138-9af5-c995c7ab74b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:02.003003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c6539-642c-4138-9af5-c995c7ab74b1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:02.013471 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1374/2745] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:58:02.018006 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:02.028309 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183206b1-e2cd-4c00-bdba-041e6fb9a121 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:02.032737 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:02.033546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:02.033886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:02.034155 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] PATH_INFO: `/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276/users/9316eeb677ac4115abb80d9b14229cfc/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:02.035989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdcdc12bd8147dbb5c6e993727c3276, user_id=9316eeb677ac4115abb80d9b14229cfc, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:02.064416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:02.083088 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1372/2746] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:02 2022] PUT /identity/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276/users/9316eeb677ac4115abb80d9b14229cfc/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:02.094722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:02.095073 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:02.095358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:02.133206 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] MFA Rules not processed for user `9316eeb677ac4115abb80d9b14229cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:02.134290 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:02.214628 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1375/2747] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:02.225108 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:02.227005 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:02.294189 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856800d-90d2-4d1e-a26a-b28c904ee4b2 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:02.297653 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de38ec-3cc2-426b-9ea7-519f7579f452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:02.298299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de38ec-3cc2-426b-9ea7-519f7579f452 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:02.299823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de38ec-3cc2-426b-9ea7-519f7579f452 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:02.299823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de38ec-3cc2-426b-9ea7-519f7579f452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:02.308625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de38ec-3cc2-426b-9ea7-519f7579f452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:02.335792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de38ec-3cc2-426b-9ea7-519f7579f452 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:02.347780 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1373/2748] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:02.835927 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:02.909005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626341b-e05f-4694-b0f4-6c6b6c899d90 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:02.914080 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:02.915160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:02.915623 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:02.916079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] PATH_INFO: `/v3/users/bb5dd69a6cda49869544edd8eb8b04c2` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:02.917470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5dd69a6cda49869544edd8eb8b04c2)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:02.946006 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:03.018094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5dd69a6cda49869544edd8eb8b04c2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.027717 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5dd69a6cda49869544edd8eb8b04c2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.029910 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5dd69a6cda49869544edd8eb8b04c2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.045796 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5dd69a6cda49869544edd8eb8b04c2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.054587 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5dd69a6cda49869544edd8eb8b04c2'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.062591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1376/2749] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:02 2022] DELETE /identity/v3/users/bb5dd69a6cda49869544edd8eb8b04c2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:03.067272 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:03.067812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:03.067812 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:03.092683 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:03.093842 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:03.165481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1374/2750] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:58:03.179472 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:03.181242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:03.253538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56fad4-451a-4c59-ab12-bd6c9ab55458 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:03.257064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:03.257656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:03.258011 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:03.258358 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:03.267855 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:03.293731 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:03.304089 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1377/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:03.794347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:03.795748 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:03.808406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2e992-eb5a-47b4-a9e5-2febd1d50346 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:03.814411 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:03.815276 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:03.815568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:03.816092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] PATH_INFO: `/v3/projects/b3a11374c7b147dcbfe42b7a65995974` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:03.823299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a11374c7b147dcbfe42b7a65995974)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:03.850315 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:03.923232 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a11374c7b147dcbfe42b7a65995974', 'request_id': 'req-9fbc6954-aed6-478c-b28c-42b69b5c5903'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.930203 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a11374c7b147dcbfe42b7a65995974', 'request_id': 'req-9fbc6954-aed6-478c-b28c-42b69b5c5903'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.942340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a11374c7b147dcbfe42b7a65995974', 'request_id': 'req-9fbc6954-aed6-478c-b28c-42b69b5c5903'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.972718 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] The token cache is being invalidate because project b3a11374c7b147dcbfe42b7a65995974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:03.972905 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.974773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:03.976720 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1375/2752] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:03 2022] DELETE /identity/v3/projects/b3a11374c7b147dcbfe42b7a65995974 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:03.980657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:03.990207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45275d6-bf40-4fc2-88aa-5c17ccc5dabe service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:04.059734 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:04.060878 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:04.061161 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:04.061433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] PATH_INFO: `/v3/users/9316eeb677ac4115abb80d9b14229cfc` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:04.062675 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9316eeb677ac4115abb80d9b14229cfc)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:04.088168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:04.141292 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9316eeb677ac4115abb80d9b14229cfc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:04.149258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9316eeb677ac4115abb80d9b14229cfc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:04.149896 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9316eeb677ac4115abb80d9b14229cfc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:04.161308 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9316eeb677ac4115abb80d9b14229cfc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:04.168936 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-e26192c1-3bdf-40a3-98a5-a626eab83e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9316eeb677ac4115abb80d9b14229cfc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:04.174962 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1378/2753] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:03 2022] DELETE /identity/v3/users/9316eeb677ac4115abb80d9b14229cfc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:58:04.805494 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:04.807052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:04.835460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc6954-aed6-478c-b28c-42b69b5c5903 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:04.907765 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:04.908989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:04.909457 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:04.909909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] PATH_INFO: `/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:04.912085 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdcdc12bd8147dbb5c6e993727c3276)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:04.939726 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:04.998637 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdcdc12bd8147dbb5c6e993727c3276', 'request_id': 'req-f1347180-07c0-458b-ab88-2fe35f452c94'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:05.004499 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdcdc12bd8147dbb5c6e993727c3276', 'request_id': 'req-f1347180-07c0-458b-ab88-2fe35f452c94'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:05.015944 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdcdc12bd8147dbb5c6e993727c3276', 'request_id': 'req-f1347180-07c0-458b-ab88-2fe35f452c94'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:05.034920 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] The token cache is being invalidate because project ccdcdc12bd8147dbb5c6e993727c3276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:05.035380 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:05.036183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-f1347180-07c0-458b-ab88-2fe35f452c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:05.038065 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1376/2754] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:04 2022] DELETE /identity/v3/projects/ccdcdc12bd8147dbb5c6e993727c3276 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:05.048320 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.050168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.050168 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.075244 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:05.076455 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:05.157012 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1379/2755] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:05.166147 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.166729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.167180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.193461 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:05.194878 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:05.209939 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1377/2756] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:05.211387 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.222433 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed56fc8-f8f3-453e-884c-f0de160c48ea None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:05.227542 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:05.228517 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.229217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.229712 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.232275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:58:05.232776 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:05.261269 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:05.279192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1380/2757] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 18:58:05.280454 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.289295 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69e6b7-ced4-40e8-bb11-4906ccdb07d7 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:05.293794 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:05.294405 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.294727 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.295011 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.295652 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:05.321983 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:05.353639 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1378/2758] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:05.357930 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.367934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0f94-949a-491c-aeb9-551f76ab1088 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:05.437678 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:05.438261 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.438520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.438839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.439543 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:05.466094 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:05.489485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1381/2759] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:58:05.493513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.504585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11effc9f-c31e-49e2-9da7-4e00196ff52d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:05.509356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cedfd-7294-4afc-8abd-26a7874b2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:05.509876 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cedfd-7294-4afc-8abd-26a7874b2002 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.510417 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cedfd-7294-4afc-8abd-26a7874b2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.510738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cedfd-7294-4afc-8abd-26a7874b2002 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.511546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cedfd-7294-4afc-8abd-26a7874b2002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:05.538313 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cedfd-7294-4afc-8abd-26a7874b2002 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:05.552703 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1379/2760] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:05.553950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.564599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add98ee-405b-44de-b9e4-2b40a37d40cf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:05.568926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:05.569815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.570104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.570388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] PATH_INFO: `/v3/projects/70bccb09706a465e857b4d45604c4613/users/d14bad7811f84b8aa79452f97928594b/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.594139 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bccb09706a465e857b4d45604c4613, user_id=d14bad7811f84b8aa79452f97928594b, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:05.620544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:05.638863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1382/2761] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:05 2022] PUT /identity/v3/projects/70bccb09706a465e857b4d45604c4613/users/d14bad7811f84b8aa79452f97928594b/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:58:05.649226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.649729 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.650188 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.688550 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] MFA Rules not processed for user `d14bad7811f84b8aa79452f97928594b`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:05.689743 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:05.763334 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1380/2762] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:58:05.767887 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.839475 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f078-cbe6-4a29-8e03-80bb73d523d5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:05.849692 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:05.850291 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:05.850614 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:05.850904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:05.851563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:05.880841 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:05.922847 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1383/2763] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:05.924266 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:05.936444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346c3d3-fcde-4e8c-ad23-181368800b83 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.004102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.004712 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.004994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.005271 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.005904 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.032865 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.057684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1381/2764] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:05 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:06.059325 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.069753 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a723-eb4c-47a2-b6cf-3a96e8c0f9bf admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.075024 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.075634 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.075923 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.076201 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.076903 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.105893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.119281 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1384/2765] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:06.123573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.132960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f14be-9673-470f-a81e-234eb3f77808 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.137440 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.138343 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.138655 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.138934 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] PATH_INFO: `/v3/projects/d42305c99c38485982ad88a28c152648/users/f7b8556108684b9a829e21f968b78bbf/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.158665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42305c99c38485982ad88a28c152648, user_id=f7b8556108684b9a829e21f968b78bbf, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.185237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.207884 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1382/2766] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:06 2022] PUT /identity/v3/projects/d42305c99c38485982ad88a28c152648/users/f7b8556108684b9a829e21f968b78bbf/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:06.212000 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.224819 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f12cd-40a0-4e4b-b22a-cf169f31cc25 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.304959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.305657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.306050 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.306597 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.307462 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.333544 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.345530 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1385/2767] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:06.349757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.361459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8132a08-898d-4451-8593-459b9c5c5cd1 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.366736 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.367811 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.368496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.368890 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] PATH_INFO: `/v3/projects/d42305c99c38485982ad88a28c152648/users/f7b8556108684b9a829e21f968b78bbf/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.371028 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42305c99c38485982ad88a28c152648, user_id=f7b8556108684b9a829e21f968b78bbf, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.399638 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.411331 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1383/2768] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:06 2022] PUT /identity/v3/projects/d42305c99c38485982ad88a28c152648/users/f7b8556108684b9a829e21f968b78bbf/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:06.415545 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.439386 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5730-3e4b-403a-bdce-9d31c5598af2 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.508099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0f52f-7166-4160-bdf3-f6876039cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.508720 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f52f-7166-4160-bdf3-f6876039cafd admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.509028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f52f-7166-4160-bdf3-f6876039cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.509327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0f52f-7166-4160-bdf3-f6876039cafd admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.510064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0f52f-7166-4160-bdf3-f6876039cafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.535374 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0f52f-7166-4160-bdf3-f6876039cafd admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.545956 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1386/2769] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:58:06.550093 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.560614 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b3b9e-a4c5-425f-9d07-b0e57424e6f0 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.565171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.565990 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.566273 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.566573 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] PATH_INFO: `/v3/projects/d42305c99c38485982ad88a28c152648/users/f7b8556108684b9a829e21f968b78bbf/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.568393 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42305c99c38485982ad88a28c152648, user_id=f7b8556108684b9a829e21f968b78bbf, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.595031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.611052 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1384/2770] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:06 2022] PUT /identity/v3/projects/d42305c99c38485982ad88a28c152648/users/f7b8556108684b9a829e21f968b78bbf/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:06.621351 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.621630 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.621959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.658852 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] MFA Rules not processed for user `f7b8556108684b9a829e21f968b78bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:06.660059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:06.746259 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1387/2771] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:06.756831 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.758562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:06.831126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1321c-c343-4bac-b43d-b86c6152ce2f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:06.835154 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:06.835746 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:06.836032 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:06.836310 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:06.847340 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:06.872835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:06.882866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1385/2772] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:58:06.986333 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:06.996563 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21f6b1-afdf-4598-8f7d-cd030d48e1e0 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:07.000217 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:07.000801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:07.001093 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:07.001372 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:07.067584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:07.092754 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:07.101848 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1388/2773] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:06 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:08.847267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:08.848668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:08.927261 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288f685-935e-4848-a8ba-419b933c469a service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:08.933436 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:08.934254 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:08.934534 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:08.935322 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] PATH_INFO: `/v3/users/6908aebf39fe480591afc319cf28d549` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:08.936481 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6908aebf39fe480591afc319cf28d549)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:08.962933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:09.107171 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6908aebf39fe480591afc319cf28d549'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.117567 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6908aebf39fe480591afc319cf28d549'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.127170 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6908aebf39fe480591afc319cf28d549'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.127821 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6908aebf39fe480591afc319cf28d549'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.128559 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6908aebf39fe480591afc319cf28d549'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.146079 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1386/2774] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:08 2022] DELETE /identity/v3/users/6908aebf39fe480591afc319cf28d549 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:09.388761 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:09.403961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624ad1-1760-4b9f-aae3-59599e99727d service cinder] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:09.475289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:09.476111 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:09.476396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:09.476676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] PATH_INFO: `/v3/projects/478112749e0846bea0d05d3073d383cd` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:09.477798 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478112749e0846bea0d05d3073d383cd)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:09.493600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:09.495304 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:09.507557 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:09.561638 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478112749e0846bea0d05d3073d383cd', 'request_id': 'req-500302a1-490e-47a0-a118-0ffb2919a5e5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.561906 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17745a-ab4b-4ef6-8314-8e30db92754c admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:09.568327 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478112749e0846bea0d05d3073d383cd', 'request_id': 'req-500302a1-490e-47a0-a118-0ffb2919a5e5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.578770 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478112749e0846bea0d05d3073d383cd', 'request_id': 'req-500302a1-490e-47a0-a118-0ffb2919a5e5'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.599509 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] The token cache is being invalidate because project 478112749e0846bea0d05d3073d383cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:09.600156 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.601112 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:09.603240 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1389/2775] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:09 2022] DELETE /identity/v3/projects/478112749e0846bea0d05d3073d383cd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:09.620414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:09.621031 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:09.621321 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:09.621606 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:09.623459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:09.704695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:09.730757 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:09.741602 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1387/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 18:58:12.557756 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:12.559441 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:12.571760 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500302a1-490e-47a0-a118-0ffb2919a5e5 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:12.576303 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:12.577102 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:12.577383 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:12.577660 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] PATH_INFO: `/v3/users/2bb5beab7e474ae998979d4d815c7acc` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:12.578913 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb5beab7e474ae998979d4d815c7acc)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:12.604363 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:12.662435 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb5beab7e474ae998979d4d815c7acc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:12.673494 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb5beab7e474ae998979d4d815c7acc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:12.674347 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb5beab7e474ae998979d4d815c7acc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:12.688492 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb5beab7e474ae998979d4d815c7acc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:12.695940 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb5beab7e474ae998979d4d815c7acc'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:12.701774 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1390/2777] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:12 2022] DELETE /identity/v3/users/2bb5beab7e474ae998979d4d815c7acc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:13.036861 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:13.046416 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19a30-1849-42ec-be83-0f6059f1d5d2 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:13.110834 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:13.111642 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:13.111930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:13.112212 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] PATH_INFO: `/v3/projects/9b10fda6245e4b409fad0032864b3671` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:13.113354 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b10fda6245e4b409fad0032864b3671)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:13.139050 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:13.203860 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b10fda6245e4b409fad0032864b3671', 'request_id': 'req-09972936-6ebd-4ef1-8114-b20c7db59baf'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.209918 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b10fda6245e4b409fad0032864b3671', 'request_id': 'req-09972936-6ebd-4ef1-8114-b20c7db59baf'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.218351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b10fda6245e4b409fad0032864b3671', 'request_id': 'req-09972936-6ebd-4ef1-8114-b20c7db59baf'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.235493 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] The token cache is being invalidate because project 9b10fda6245e4b409fad0032864b3671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:13.235781 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.236464 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.237940 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1388/2778] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:13 2022] DELETE /identity/v3/projects/9b10fda6245e4b409fad0032864b3671 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:13.242680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:13.244079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:13.257131 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603ddea-1c21-4d37-9d52-3f2b855d5694 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:13.324407 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:13.325218 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:13.325765 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:13.326056 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] PATH_INFO: `/v3/users/dcf23bdaa96941e3b554d8dd458911c1` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:13.327318 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf23bdaa96941e3b554d8dd458911c1)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:13.353361 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:13.421826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf23bdaa96941e3b554d8dd458911c1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.434115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf23bdaa96941e3b554d8dd458911c1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.435086 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf23bdaa96941e3b554d8dd458911c1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.446837 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf23bdaa96941e3b554d8dd458911c1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.454733 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf23bdaa96941e3b554d8dd458911c1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.460762 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1391/2779] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:13 2022] DELETE /identity/v3/users/dcf23bdaa96941e3b554d8dd458911c1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:13.684351 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:13.686135 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:13.698631 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09972936-6ebd-4ef1-8114-b20c7db59baf admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:13.764992 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:13.765817 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:13.766097 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:13.766369 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] PATH_INFO: `/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:13.767496 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c70f9c043f14f20b46b2bb5fdeb259b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:13.793145 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:13.851594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c70f9c043f14f20b46b2bb5fdeb259b', 'request_id': 'req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.856622 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c70f9c043f14f20b46b2bb5fdeb259b', 'request_id': 'req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.865814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c70f9c043f14f20b46b2bb5fdeb259b', 'request_id': 'req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.883414 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] The token cache is being invalidate because project 1c70f9c043f14f20b46b2bb5fdeb259b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:13.883706 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.884395 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-c0f21fe6-bd99-46a1-9dd4-a981e28c8bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:13.885938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1389/2780] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:13 2022] DELETE /identity/v3/projects/1c70f9c043f14f20b46b2bb5fdeb259b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:18.389596 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:18.391041 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:18.403664 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97b50b-517f-4b3d-af88-5457b2777820 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:18.466498 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:18.467338 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:18.467631 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:18.467915 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] PATH_INFO: `/v3/users/d14bad7811f84b8aa79452f97928594b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:18.469064 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14bad7811f84b8aa79452f97928594b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:18.494606 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:18.554485 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14bad7811f84b8aa79452f97928594b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:18.565965 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14bad7811f84b8aa79452f97928594b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:18.566941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14bad7811f84b8aa79452f97928594b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:18.581394 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14bad7811f84b8aa79452f97928594b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:18.589097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14bad7811f84b8aa79452f97928594b'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:18.595113 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1392/2781] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:18 2022] DELETE /identity/v3/users/d14bad7811f84b8aa79452f97928594b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:18.599635 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:18.600141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:18.600141 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:18.625448 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:18.626532 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:18.695290 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1390/2782] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:58:18.709153 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:18.710777 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:18.781418 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7208af6-903d-4930-91d5-9a0cee6e7ec3 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:18.787907 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:18.788812 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:18.789236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:18.789652 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:18.800681 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:18.827057 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:18.836735 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1393/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:19.200874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:19.202804 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:19.217375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c1af-0292-450a-9a18-f5c69c0f311b None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:19.222373 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:19.223280 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:19.223570 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:19.223852 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] PATH_INFO: `/v3/projects/70bccb09706a465e857b4d45604c4613` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:19.224995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bccb09706a465e857b4d45604c4613)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:19.250468 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:19.303243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bccb09706a465e857b4d45604c4613', 'request_id': 'req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.309556 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bccb09706a465e857b4d45604c4613', 'request_id': 'req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.318357 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bccb09706a465e857b4d45604c4613', 'request_id': 'req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.334350 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] The token cache is being invalidate because project 70bccb09706a465e857b4d45604c4613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:19.334692 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.335299 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.336788 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1391/2784] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:19 2022] DELETE /identity/v3/projects/70bccb09706a465e857b4d45604c4613 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:19.342055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:19.356643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe922c6-eefd-4252-bae3-d95d21a15ef4 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:19.428863 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:19.429535 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:19.429827 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:19.430088 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] PATH_INFO: `/v3/users/f7b8556108684b9a829e21f968b78bbf` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:19.431319 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b8556108684b9a829e21f968b78bbf)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:19.457702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:19.519260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b8556108684b9a829e21f968b78bbf'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.529258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b8556108684b9a829e21f968b78bbf'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.529926 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b8556108684b9a829e21f968b78bbf'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.541266 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b8556108684b9a829e21f968b78bbf'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.549392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-97854726-0564-4bac-8ebc-81919b8a6ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b8556108684b9a829e21f968b78bbf'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:19.555200 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1394/2785] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:19 2022] DELETE /identity/v3/users/f7b8556108684b9a829e21f968b78bbf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:19.921360 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:19.923460 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:19.936813 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf971c-bd2d-4045-bdbc-7a860e8c5ead admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.000604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.001401 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.001684 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.001933 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] PATH_INFO: `/v3/projects/d42305c99c38485982ad88a28c152648` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.003017 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42305c99c38485982ad88a28c152648)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.029059 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.088928 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42305c99c38485982ad88a28c152648', 'request_id': 'req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:20.094216 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42305c99c38485982ad88a28c152648', 'request_id': 'req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:20.103973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42305c99c38485982ad88a28c152648', 'request_id': 'req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:20.120009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] The token cache is being invalidate because project d42305c99c38485982ad88a28c152648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:20.120286 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:20.120900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-88cf4e6e-00c2-44bc-ba2d-6dffa56b27dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:20.122965 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1392/2786] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:19 2022] DELETE /identity/v3/projects/d42305c99c38485982ad88a28c152648 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:20.127916 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.128210 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.128491 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.151378 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:20.152561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:20.232008 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1395/2787] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:20.240115 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.240404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.240691 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.266611 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:20.267666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:20.275284 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1393/2788] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:20.280189 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:20.292179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bdf06-7d32-44a6-82ba-4f8e3c571184 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.297257 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.297839 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.298121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.298396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.299122 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:58:20.299416 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.325242 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.339375 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1396/2789] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:58:20.343880 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:20.353237 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc5e4-5f1d-4e3c-9997-a93e5446be5a None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.358312 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.358922 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.359205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.359479 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.360125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.385530 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.416866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1394/2790] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:20.421674 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:20.432260 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac7819-e792-45b7-9e69-5a810340aa04 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.500599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.501222 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.501533 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.501811 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.502470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.528538 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.550565 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1397/2791] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:20.554745 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:20.565020 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2c47-6c4e-430d-a1dc-6d995e623d93 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.569307 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004035f-b8fd-4713-8984-222d670b8c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.569900 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004035f-b8fd-4713-8984-222d670b8c2c admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.570176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004035f-b8fd-4713-8984-222d670b8c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.570474 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004035f-b8fd-4713-8984-222d670b8c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.571238 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004035f-b8fd-4713-8984-222d670b8c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.596506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004035f-b8fd-4713-8984-222d670b8c2c admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.607621 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1395/2792] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:20.614121 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:20.627263 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88334-97e6-483e-ab5c-99620ef8e0b9 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.633044 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.633861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.634150 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.634423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] PATH_INFO: `/v3/projects/bb02671ee3e04e4ab9ec9b099e80d30c/users/82524c9a15fa43c4bbf30d027c27174e/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.657364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb02671ee3e04e4ab9ec9b099e80d30c, user_id=82524c9a15fa43c4bbf30d027c27174e, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.684558 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.704699 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1398/2793] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:20 2022] PUT /identity/v3/projects/bb02671ee3e04e4ab9ec9b099e80d30c/users/82524c9a15fa43c4bbf30d027c27174e/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:20.715604 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.715936 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.716217 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.753281 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] MFA Rules not processed for user `82524c9a15fa43c4bbf30d027c27174e`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:20.754424 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:20.846506 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1396/2794] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:20.852781 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:20.928120 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c19a0-0b5b-466f-9943-20f0ab5916ef admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:20.935561 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:20.936141 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:20.936450 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:20.936728 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:20.937377 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:20.962991 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:20.992959 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1399/2795] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:20.996989 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.008688 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76fada-800e-497d-8098-96517254c0d0 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.076443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.077034 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.077311 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.077589 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] PATH_INFO: `/v3/users` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.078229 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.104342 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.127673 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1397/2796] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:20 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:21.133289 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.143369 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6d8ca-fe93-41fe-83e4-22bfcd2f6db8 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.147884 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.148470 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.148758 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.149034 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.149724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.175204 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.189220 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1400/2797] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:21.194398 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.207259 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c15a-51d3-44d0-a9b2-139db6adb112 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.211994 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.212823 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.213109 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.213389 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] PATH_INFO: `/v3/projects/98dd1c88db594b049faa42aa47b82f57/users/3bbc3b89ddda484e81db007ff84889d3/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.233996 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dd1c88db594b049faa42aa47b82f57, user_id=3bbc3b89ddda484e81db007ff84889d3, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.268476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.287541 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1398/2798] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:21 2022] PUT /identity/v3/projects/98dd1c88db594b049faa42aa47b82f57/users/3bbc3b89ddda484e81db007ff84889d3/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:21.293499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.308021 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da1a3-6554-4201-952d-414f62a809eb admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.377031 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.377551 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.377838 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.378115 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.378842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.404341 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.415059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1401/2799] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:21.419695 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.430501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c2b29-9a46-4840-b5c4-273aa44dd50d admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.436432 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.437253 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.437538 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.437814 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] PATH_INFO: `/v3/projects/98dd1c88db594b049faa42aa47b82f57/users/3bbc3b89ddda484e81db007ff84889d3/roles/65cb1c6508a34cfb9eb638fffbccb91f` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.439738 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dd1c88db594b049faa42aa47b82f57, user_id=3bbc3b89ddda484e81db007ff84889d3, role_id=65cb1c6508a34cfb9eb638fffbccb91f)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.466593 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.477835 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1399/2800] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:21 2022] PUT /identity/v3/projects/98dd1c88db594b049faa42aa47b82f57/users/3bbc3b89ddda484e81db007ff84889d3/roles/65cb1c6508a34cfb9eb638fffbccb91f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:21.482414 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.493197 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810819-3b48-46e3-9210-a5dd439e6083 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.561207 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46c20-5f2d-4298-8f47-237f793ee5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.561803 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46c20-5f2d-4298-8f47-237f793ee5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.562087 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46c20-5f2d-4298-8f47-237f793ee5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.562364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46c20-5f2d-4298-8f47-237f793ee5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.563085 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e46c20-5f2d-4298-8f47-237f793ee5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.588357 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e46c20-5f2d-4298-8f47-237f793ee5c8 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.599286 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1402/2801] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 18:58:21.604540 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.621575 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b414d5-95fa-4ba1-a23b-48730a4fa43f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.626645 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.627526 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] REQUEST_METHOD: `PUT` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.627715 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.628161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] PATH_INFO: `/v3/projects/98dd1c88db594b049faa42aa47b82f57/users/3bbc3b89ddda484e81db007ff84889d3/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.630151 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dd1c88db594b049faa42aa47b82f57, user_id=3bbc3b89ddda484e81db007ff84889d3, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.658513 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.681909 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1400/2802] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:21 2022] PUT /identity/v3/projects/98dd1c88db594b049faa42aa47b82f57/users/3bbc3b89ddda484e81db007ff84889d3/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:21.694293 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.694616 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.694901 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.733147 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] MFA Rules not processed for user `3bbc3b89ddda484e81db007ff84889d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:21.734300 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:21.815295 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1403/2803] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3763 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:21.825629 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:21.828182 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:21.901832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ce65f-e5a1-47ef-9b3e-ef77e85af01f admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:21.905689 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95683586-3509-4f1a-b012-cd50b61c71b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:21.906278 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95683586-3509-4f1a-b012-cd50b61c71b7 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:21.906584 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95683586-3509-4f1a-b012-cd50b61c71b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:21.906896 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95683586-3509-4f1a-b012-cd50b61c71b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:21.917230 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95683586-3509-4f1a-b012-cd50b61c71b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:21.943162 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95683586-3509-4f1a-b012-cd50b61c71b7 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:21.954048 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1401/2804] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:21 2022] GET /identity/v3/auth/tokens => generated 3763 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:22.085101 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:22.156842 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8e1d9-ce8f-4dc5-9907-312f0ab345bb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:22.161672 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:22.162466 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:22.162782 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:22.163059 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] PATH_INFO: `/v3/users/82524c9a15fa43c4bbf30d027c27174e` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:22.164192 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82524c9a15fa43c4bbf30d027c27174e)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:22.189724 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:22.240680 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82524c9a15fa43c4bbf30d027c27174e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:22.250185 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82524c9a15fa43c4bbf30d027c27174e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:22.250816 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82524c9a15fa43c4bbf30d027c27174e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:22.262138 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82524c9a15fa43c4bbf30d027c27174e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:22.269512 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82524c9a15fa43c4bbf30d027c27174e'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:22.275584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1404/2805] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:22 2022] DELETE /identity/v3/users/82524c9a15fa43c4bbf30d027c27174e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:22.280485 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:22.280973 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:22.281081 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:22.304659 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:22.305786 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:22.379132 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1402/2806] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:22.391588 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:22.392950 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:22.465052 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088cd6b-4d3b-44f3-bb42-3f62f30e2205 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:22.469843 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:22.470431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:22.470820 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:22.471095 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:22.481861 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:22.507030 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:22.516415 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1405/2807] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:22.891633 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:22.893056 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:22.904985 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593d2b8-4c95-49a7-a4b3-9d5314c3b648 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:22.911111 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:22.911898 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:22.912181 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:22.912459 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] PATH_INFO: `/v3/projects/bb02671ee3e04e4ab9ec9b099e80d30c` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:22.913669 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb02671ee3e04e4ab9ec9b099e80d30c)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:22.940430 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:23.001568 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb02671ee3e04e4ab9ec9b099e80d30c', 'request_id': 'req-34303913-aadf-4c9c-8240-40672aea7a8b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.007274 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb02671ee3e04e4ab9ec9b099e80d30c', 'request_id': 'req-34303913-aadf-4c9c-8240-40672aea7a8b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.017956 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb02671ee3e04e4ab9ec9b099e80d30c', 'request_id': 'req-34303913-aadf-4c9c-8240-40672aea7a8b'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.034704 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] The token cache is being invalidate because project bb02671ee3e04e4ab9ec9b099e80d30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:23.034919 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.035666 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.037248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1403/2808] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:22 2022] DELETE /identity/v3/projects/bb02671ee3e04e4ab9ec9b099e80d30c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:23.041431 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:23.051099 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02645a5-d398-4795-b934-6f49a34d7243 service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:23.117661 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:23.118499 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:23.118826 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:23.119104 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] PATH_INFO: `/v3/users/3bbc3b89ddda484e81db007ff84889d3` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:23.120209 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbc3b89ddda484e81db007ff84889d3)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:23.145406 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:23.203312 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbc3b89ddda484e81db007ff84889d3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.213714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbc3b89ddda484e81db007ff84889d3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.214403 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbc3b89ddda484e81db007ff84889d3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.226258 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbc3b89ddda484e81db007ff84889d3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.233904 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ecc969ab-6092-4e65-a294-79852ce10723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbc3b89ddda484e81db007ff84889d3'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.239807 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1406/2809] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:23 2022] DELETE /identity/v3/users/3bbc3b89ddda484e81db007ff84889d3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:23.606347 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:23.607849 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:23.620206 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34303913-aadf-4c9c-8240-40672aea7a8b admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:23.686314 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:23.687260 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:23.687519 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:23.687792 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] PATH_INFO: `/v3/projects/98dd1c88db594b049faa42aa47b82f57` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:23.689071 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98dd1c88db594b049faa42aa47b82f57)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:23.714724 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:23.780375 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dd1c88db594b049faa42aa47b82f57', 'request_id': 'req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.785492 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dd1c88db594b049faa42aa47b82f57', 'request_id': 'req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.794947 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dd1c88db594b049faa42aa47b82f57', 'request_id': 'req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.812161 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] The token cache is being invalidate because project 98dd1c88db594b049faa42aa47b82f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:23.812443 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.813122 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-e6f7724e-058c-4ff7-a37d-b8b95a0c13f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:23.814663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1404/2810] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:23 2022] DELETE /identity/v3/projects/98dd1c88db594b049faa42aa47b82f57 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:23.820941 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:23.821423 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:23.821520 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:23.844323 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:23.845484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:23.918656 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1407/2811] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:58:23.929663 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:23.929960 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:23.930240 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:23.954227 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:23.955413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:23.964241 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1405/2812] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:23.971033 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:23.981690 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1ded6-4d80-4e7d-b5f6-7db318e50fcb None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:23.987079 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:23.987666 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:23.987949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:23.988227 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] PATH_INFO: `/v3/domains` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:23.988919 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66296) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Feb 28 18:58:23.989214 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:24.014620 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:24.028452 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1408/2813] 10.222.0.18 () {58 vars in 1152 bytes} [Mon Feb 28 18:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 18:58:24.035033 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:24.044498 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524f2e1-8968-42ae-83d9-84debdf6a823 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:24.049228 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:24.049807 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.050092 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.050372 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] PATH_INFO: `/v3/projects` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.051044 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:24.077426 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:24.108476 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1406/2814] 10.222.0.18 () {60 vars in 1152 bytes} [Mon Feb 28 18:58:24 2022] POST /identity/v3/projects => generated 359 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 18:58:24.112599 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:24.122584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa30c2-9a96-4018-961a-764946e5946d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:24.187618 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:24.188228 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.188506 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.188779 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] PATH_INFO: `/v3/users` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.189396 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:24.215504 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:24.238786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1409/2815] 10.222.0.18 () {60 vars in 1143 bytes} [Mon Feb 28 18:58:24 2022] POST /identity/v3/users => generated 280 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 18:58:24.243234 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:24.259245 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe74da-ac52-463c-975f-d4b6b1e1ff67 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:24.265235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624cd2-6470-4ab8-bd22-f4f45a198995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:24.265836 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624cd2-6470-4ab8-bd22-f4f45a198995 admin admin] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.266129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624cd2-6470-4ab8-bd22-f4f45a198995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.266412 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624cd2-6470-4ab8-bd22-f4f45a198995 admin admin] PATH_INFO: `/v3/roles` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.267155 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624cd2-6470-4ab8-bd22-f4f45a198995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:24.292778 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624cd2-6470-4ab8-bd22-f4f45a198995 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:24.303327 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1407/2816] 10.222.0.18 () {58 vars in 1121 bytes} [Mon Feb 28 18:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 18:58:24.309437 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:24.319555 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ea2fd-32be-4c5b-9598-3a1b2a51380d admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:24.324366 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159da77-8ea2-443c-9971-c13563b877de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:24.325364 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159da77-8ea2-443c-9971-c13563b877de admin admin] REQUEST_METHOD: `PUT` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.325650 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159da77-8ea2-443c-9971-c13563b877de admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.325932 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159da77-8ea2-443c-9971-c13563b877de admin admin] PATH_INFO: `/v3/projects/b217a1e1b7c3494eb77686d1deb187c6/users/486263c073d2419585d32b485bbd6ed1/roles/3038e8c9361243ec8eb72096cd6ca12b` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.346055 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159da77-8ea2-443c-9971-c13563b877de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217a1e1b7c3494eb77686d1deb187c6, user_id=486263c073d2419585d32b485bbd6ed1, role_id=3038e8c9361243ec8eb72096cd6ca12b)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:24.372003 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159da77-8ea2-443c-9971-c13563b877de admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:24.387929 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1410/2817] 10.222.0.18 () {60 vars in 1482 bytes} [Mon Feb 28 18:58:24 2022] PUT /identity/v3/projects/b217a1e1b7c3494eb77686d1deb187c6/users/486263c073d2419585d32b485bbd6ed1/roles/3038e8c9361243ec8eb72096cd6ca12b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 18:58:24.399157 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393b4f5-1ebd-4ed0-b58e-b3bae19af64f None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.399555 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393b4f5-1ebd-4ed0-b58e-b3bae19af64f None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.399971 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393b4f5-1ebd-4ed0-b58e-b3bae19af64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.439502 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-1393b4f5-1ebd-4ed0-b58e-b3bae19af64f None None] MFA Rules not processed for user `486263c073d2419585d32b485bbd6ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:24.440648 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-1393b4f5-1ebd-4ed0-b58e-b3bae19af64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:24.530164 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1408/2818] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3666 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:24.564780 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e7866-5ac9-4f17-9c2e-aa4c6911fa43 None None] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.565075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e7866-5ac9-4f17-9c2e-aa4c6911fa43 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.565355 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e7866-5ac9-4f17-9c2e-aa4c6911fa43 None None] PATH_INFO: `/` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.567091 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1411/2819] 10.222.0.18 () {54 vars in 962 bytes} [Mon Feb 28 18:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 18:58:24.571886 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] REQUEST_METHOD: `POST` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.572183 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.572470 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.623866 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.auth.core [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] MFA Rules not processed for user `d60d7d7120b047c5b45fb922c8063048`. Rule list: `[]` (Enabled: `True`). {{(pid=66297) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:24.624930 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:24.692397 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1409/2820] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Feb 28 18:58:24 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 18:58:24.700392 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e7866-5ac9-4f17-9c2e-aa4c6911fa43 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:24.712028 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e7866-5ac9-4f17-9c2e-aa4c6911fa43 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:24.715967 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436237e1-67e7-4adb-9537-29a2f8eb4f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:24.716567 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436237e1-67e7-4adb-9537-29a2f8eb4f6e service cinder] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:24.716856 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436237e1-67e7-4adb-9537-29a2f8eb4f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:24.717133 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436237e1-67e7-4adb-9537-29a2f8eb4f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:24.725349 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436237e1-67e7-4adb-9537-29a2f8eb4f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:24.750579 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436237e1-67e7-4adb-9537-29a2f8eb4f6e service cinder] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:24.759676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1412/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:24 2022] GET /identity/v3/auth/tokens => generated 3666 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:24.919352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:25.018352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ef9bc-1fa3-491a-9432-2b370f5139d4 None None] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:25.024150 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:25.024961 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:25.025248 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:25.025525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] PATH_INFO: `/v3/users/486263c073d2419585d32b485bbd6ed1` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:25.026749 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486263c073d2419585d32b485bbd6ed1)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:25.053668 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:25.109995 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486263c073d2419585d32b485bbd6ed1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.118054 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486263c073d2419585d32b485bbd6ed1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.128941 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486263c073d2419585d32b485bbd6ed1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.129740 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486263c073d2419585d32b485bbd6ed1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.130660 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486263c073d2419585d32b485bbd6ed1'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.153096 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1410/2822] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 18:58:24 2022] DELETE /identity/v3/users/486263c073d2419585d32b485bbd6ed1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:58:25.158502 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:25.159023 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:25.159118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:25.186874 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] MFA Rules not processed for user `3e8eb57551f64caeac7429bc645c3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:58:25.188020 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:25.254704 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1413/2823] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:58:25.268121 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:25.270117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:25.342338 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeedf0d-153b-44ca-8262-dd7ca1770f22 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:25.346267 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:25.346879 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:25.347165 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:25.347444 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:25.356730 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:25.381937 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:25.391711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1411/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:58:25.754834 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:58:25.756461 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:58:25.769014 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74cfd9-40b2-44d1-b051-8c89c6ee6271 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:58:25.773961 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:58:25.774785 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:58:25.775075 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:58:25.775348 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] PATH_INFO: `/v3/projects/b217a1e1b7c3494eb77686d1deb187c6` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:58:25.776508 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b217a1e1b7c3494eb77686d1deb187c6)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:58:25.803170 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:58:25.860799 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b217a1e1b7c3494eb77686d1deb187c6', 'request_id': 'req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.866069 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b217a1e1b7c3494eb77686d1deb187c6', 'request_id': 'req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.878005 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b217a1e1b7c3494eb77686d1deb187c6', 'request_id': 'req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.902484 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] The token cache is being invalidate because project b217a1e1b7c3494eb77686d1deb187c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66296) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 18:58:25.902958 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.903591 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-05909c8f-a9d8-48a8-aa84-3d0169cb1ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 18:58:25.905166 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1414/2825] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 18:58:25 2022] DELETE /identity/v3/projects/b217a1e1b7c3494eb77686d1deb187c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 18:59:20.920517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:20.922483 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:21.029755 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af22bc-b528-427f-861a-a743eabf3ea6 service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:21.086243 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd60d7d7120b047c5b45fb922c8063048', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:21.086859 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:21.087126 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:21.087406 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:21.089382 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:21.170112 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:59:21.201557 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:21.214546 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1412/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:20 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:30.925212 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] REQUEST_METHOD: `POST` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:30.925808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:30.925808 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:30.950097 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.auth.core [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] MFA Rules not processed for user `549b7a82cab9488a815c3e68a95b10db`. Rule list: `[]` (Enabled: `True`). {{(pid=66296) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 18:59:30.951275 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:30.958751 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1415/2827] 10.222.0.18 () {58 vars in 957 bytes} [Mon Feb 28 18:59:30 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 18:59:32.064057 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:32.065525 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:32.150332 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0164f7a-5387-4558-b236-64f81fda8418 service cinder] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:32.155086 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:32.155654 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:32.155943 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:32.156287 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:32.157964 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:32.168594 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:59:32.194176 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:32.204205 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1413/2828] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:32 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:32.352179 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:32.353676 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:32.368388 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1f8a-ed0b-49d4-b593-dcbbd98d0e21 None None] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:32.373584 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:32.374151 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:32.374434 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:32.374736 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:32.376622 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:32.387117 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:59:32.412742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:32.422127 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1416/2829] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:32 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:47.476560 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:47.478764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:47.564129 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772a051-d3e9-4ad4-967d-5703cb7ffc58 service placement] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:47.569376 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:47.569963 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:47.570247 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:47.570524 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:47.572180 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:47.583665 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:59:47.609016 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:47.620001 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1414/2830] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:47 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:50.143298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:50.145449 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:50.249786 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc5a9d-35bd-4140-b40c-3bed78e7494a service placement] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:50.254276 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:50.254879 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:50.255160 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:50.255464 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:50.257236 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:50.334171 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:59:50.359288 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:50.372589 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1417/2831] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:50 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 18:59:53.016783 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 18:59:53.028075 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459ff77-71d2-4356-90cb-3433f3367a41 service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 18:59:53.034600 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df0c8ccfb9944d4a8d0ccb4745bc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 18:59:53.035214 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 18:59:53.035501 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 18:59:53.035773 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 18:59:53.037507 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 18:59:53.049404 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 18:59:53.079618 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 18:59:53.090628 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1415/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 18:59:53 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:00:12.725268 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:00:12.749722 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8487cc-d8c7-4b11-af5e-79ec4620b99d service neutron] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:00:12.756157 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:00:12.756714 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:00:12.757043 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:00:12.757273 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:00:12.759148 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:00:12.788457 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:00:12.814298 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:00:12.825307 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1418/2833] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 19:00:12 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:01:58.507409 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:01:58.521562 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655274d-474a-40ff-9a98-ae7836e2c831 service nova] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:01:58.527938 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05012414e8a946fcbbaef5a317a19433', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:01:58.528741 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] REQUEST_METHOD: `GET` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:01:58.529102 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:01:58.529453 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:01:58.532029 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:01:58.635125 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:01:58.660134 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:01:58.682323 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1416/2834] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 19:01:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 19:02:10.047162 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.048642 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.061792 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10929-02f4-4cfa-886e-1e3748f4a7cc service placement] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.065789 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.066702 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.067225 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.067569 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] PATH_INFO: `/v3/users/549b7a82cab9488a815c3e68a95b10db` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.068703 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549b7a82cab9488a815c3e68a95b10db)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:02:10.094118 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.152296 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549b7a82cab9488a815c3e68a95b10db'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.160657 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549b7a82cab9488a815c3e68a95b10db'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.161282 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549b7a82cab9488a815c3e68a95b10db'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.173793 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549b7a82cab9488a815c3e68a95b10db'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.181795 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549b7a82cab9488a815c3e68a95b10db'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.187742 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1419/2835] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:10 2022] DELETE /identity/v3/users/549b7a82cab9488a815c3e68a95b10db => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:10.426303 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.437935 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86365bba-26a5-4e3a-a323-ea988f22933e service neutron] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.508117 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.508946 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.509226 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.509505 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] PATH_INFO: `/v3/projects/16e7d713da4349b3977dab0041ed0bee` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.510681 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e7d713da4349b3977dab0041ed0bee)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:02:10.536685 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.596832 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e7d713da4349b3977dab0041ed0bee', 'request_id': 'req-885d8445-b3b1-4fee-9c39-b9833dfd5f63'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.602764 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e7d713da4349b3977dab0041ed0bee', 'request_id': 'req-885d8445-b3b1-4fee-9c39-b9833dfd5f63'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.611116 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e7d713da4349b3977dab0041ed0bee', 'request_id': 'req-885d8445-b3b1-4fee-9c39-b9833dfd5f63'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.627728 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] The token cache is being invalidate because project 16e7d713da4349b3977dab0041ed0bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:10.628009 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.628625 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.630711 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1417/2836] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:10 2022] DELETE /identity/v3/projects/16e7d713da4349b3977dab0041ed0bee => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:02:10.635373 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:10.636732 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:10.649440 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0803-caae-46e4-b566-2201871fedd6 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:10.716411 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:10.717213 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:10.717487 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:10.717787 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] PATH_INFO: `/v3/users/878dcd37521b40a39f68c714576de60d` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:10.718988 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878dcd37521b40a39f68c714576de60d)` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:02:10.744934 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:10.804955 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878dcd37521b40a39f68c714576de60d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.813707 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878dcd37521b40a39f68c714576de60d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.814271 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878dcd37521b40a39f68c714576de60d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.826643 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878dcd37521b40a39f68c714576de60d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.835746 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.notifications [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878dcd37521b40a39f68c714576de60d'} {{(pid=66296) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:10.841737 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1420/2837] 10.222.0.18 () {58 vars in 1223 bytes} [Mon Feb 28 19:02:10 2022] DELETE /identity/v3/users/878dcd37521b40a39f68c714576de60d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 19:02:11.084078 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Authenticating user token {{(pid=66297) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:02:11.085585 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.fernet_utils [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66297) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:02:11.099352 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d8445-b3b1-4fee-9c39-b9833dfd5f63 admin admin] Validating token access rules against request {{(pid=66297) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:02:11.162408 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e8eb57551f64caeac7429bc645c3ee4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59acec3e713d40f0a23abdd9569d7387', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66297) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:02:11.163235 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:02:11.163517 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:02:11.163787 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] PATH_INFO: `/v3/projects/bfc39115fa0644a5a324aa4890e86bfc` {{(pid=66297) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:02:11.164874 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc39115fa0644a5a324aa4890e86bfc)` {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:02:11.191197 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] RBAC: Authorization granted {{(pid=66297) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:02:11.247413 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc39115fa0644a5a324aa4890e86bfc', 'request_id': 'req-43d65461-b6a6-466e-b927-af0a7d4606bc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.256265 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc39115fa0644a5a324aa4890e86bfc', 'request_id': 'req-43d65461-b6a6-466e-b927-af0a7d4606bc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.266913 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc39115fa0644a5a324aa4890e86bfc', 'request_id': 'req-43d65461-b6a6-466e-b927-af0a7d4606bc'} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.290333 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] The token cache is being invalidate because project bfc39115fa0644a5a324aa4890e86bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66297) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 19:02:11.290608 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.291356 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: DEBUG keystone.notifications [None req-43d65461-b6a6-466e-b927-af0a7d4606bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66297) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 19:02:11.293061 dv-cinder-831188-1-iscsi devstack@keystone.service[66297]: [pid: 66297|app: 0|req: 1418/2838] 10.222.0.18 () {58 vars in 1232 bytes} [Mon Feb 28 19:02:11 2022] DELETE /identity/v3/projects/bfc39115fa0644a5a324aa4890e86bfc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 19:05:19.963893 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Authenticating user token {{(pid=66296) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 19:05:19.965993 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:20.052562 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06d802-57ee-4fc3-b880-6267c78f7cf1 admin admin] Validating token access rules against request {{(pid=66296) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 19:05:20.118636 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428c5ed13bcf410490fbac7a992a86ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '425465b255334cc286e615b5dc15c6e1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66296) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 19:05:20.119234 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] REQUEST_METHOD: `GET` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 19:05:20.119522 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] SCRIPT_NAME: `/identity` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 19:05:20.119801 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66296) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 19:05:20.121949 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.fernet_utils [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66296) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 19:05:20.132815 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Feb 28 19:05:20.158215 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa9871-8b9d-4adb-81f6-2f44f3f75018 service placement] RBAC: Authorization granted {{(pid=66296) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 19:05:20.167897 dv-cinder-831188-1-iscsi devstack@keystone.service[66296]: [pid: 66296|app: 0|req: 1421/2839] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Feb 28 19:05:19 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)